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Description 



[0001] The present invention relates to systems for smoothly concatenating quasi-periodic waveforms, such as en- 
coded diphone records used in translating text in a computer system to synthesized speech. 

s [0002] In text-to-speech systems, stored text in a computer is translated to synthesized speech. As can be appreci- 
ated, this kind of system would have wide spread application if it were of reasonable cost. For instance, a text-to- 
speech system could be used for reviewing electronic mail remotely across a telephone line, by causing the computer 
storing the electronic mail to synthesize speech representing the electronic mail. Also, such systems could be used 
for reading to people who are visually impaired. In the word processing context, text-to-speech systems might be used 

10 to assist in proofreading a large document. 

[0003] However in prior art systems which have reasonable cost, the quality of the speech has been relatively poor 
making it uncomfortable to use or difficult to understand. In order to achieve good quality speech, prior art speech 
synthesis systems need specialized hardware which is very expensive, and/or a large amount of memory space in the 
computer system generating the sound. 

is [0004] In text-to-speech systems, an algorithm reviews an input text string, and translates the words in the text string 
into a sequence of diphones which must be translated into synthesized speech. Also, text-to-speech systems analyze 
the text based on word type and context to generate intonation control used for adjusting the duration of the sounds 
and the pitch of the sounds involved in the speech. 

[0005] Diphones consist of a unit of speech composed of the transition between one sound, or phoneme, and an 
20 adjacent sound, or phoneme. Diphones typically start at the center of one phoneme and end at the center of a neigh- 
boring phoneme. This preserves the transition between the sounds relatively well. 

[0006] American English based text-to-speech systems, depending on the particular implementation, use about fifty 
different sounds referred to as phones. Of these fifty different sounds, the standard language uses about 1 800 diphones 
out of possible 2500 phone pairs. Thus, a text-to-speech system must be capable of reproducing 1800 diphones. To 
2S store the speech data directly for each diphone would involve a huge amount of memory. Thus, compression techniques 
have evolved to limit the amount of memory required for storing the diphones. 

[0007] Prior art text-to-speech systems are described in part in United States Patent No. 8,452,1 68, entitled COM- 
PRESSION OF STORED WAVE FORMS FOR ARTIFICIAL SPEECH, invented by Sprague; and United States Patent 
No. 4,692,941, entitled REAL-TIME TEXT-TO-SPEECH CONVERSION SYSTEM, invented by Jacks, et al. Further 
30 background concerning speech synthesis may be found in United States Patent No. 4,384,1 69, entitled METHOD AND 
APPARATUS FOR SPEECH SYNTHESIZING, invented by Mozer, et al. 

[0008] Two concatenated diphones will have an ending frame and a beginning frame. The ending frame of the left 
diphone must be blended with the beginning frame of the right diphone without audible discontinuities or clicks being 
generated. Since the right boundary of the first diphone and the left boundary of the second diphone correspond to 

35 the same phoneme in most situations, they are expected to be similar looking at the point of concatenation. However, 
because the two diphone codings are extracted from different contexts, they will not look identical. Thus, blending 
techniques of the prior art have attempted to blend concatenated waveforms at the end and beginning of left and right 
frames, respectively. Because the end and beginning of frames may not match well, blending noise results. Continuity 
of sound between adjacent diphones is thus distorted. 

40 [0009] Notwithstanding the prior work in this area, the use of text-to-speech systems has not gained widespread 
acceptance. It is desireable therefore to provide a software only text-to-speech system which is portable to a wide 
variety of microcomputer platforms, produces high quality speech and operates in real time on such platforms. 
[0010] According to a first aspect, the present invention provides an apparatus for concatenating a first digital frame 
of N samples having respective magnitudes representing a first quasi-periodic waveform and a second digital frame 

45 of M samples having respective magnitudes representing a second quasi-periodic waveform, comprising: 

a buffer to store the samples of first and second digital frames; 

means, coupled to the buffer store, for determining a blend point for the first and second digital frames in response 
to magnitudes of samples in the first and second digital frames; 
so blending means, coupled with the buffer store and the means for determining, for computing a digital sequence 

representing a concatenation of the first and second quasi-periodic waveforms in response to the first frame, the 
second frame and the blend point. 

[0011] Further, the technique is applicable to concatenating any two quasi-periodic waveforms, commonly encoun- 
55 tered in sound synthesis or speech, music, sound effects, or the like. 

[0012] According to one embodiment of the present invention, the system operates by first computing an extended 
frame in response to the first digital frame, and then finding a subset of the extended frame which matches the second 
digital frame relatively well. The optimum blend point is then defined as a sample in the subset of the extended frame. 
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The subset of the extended frame which matches the second digital frame relatively well is determined using a minimum 
average magnitude difference function over the samples in the subset. The blend point in this aspect comprises the 
first sample of the subset. To generate the concatenated waveform, the subset of the extended frame is combined with 
the second digital frame and concatenated with the beginning segment of the extended frame to produce the concate- 
s nated waveform. 

[0013] The concatenated sequence is then converted to analog form, or other physical representation of the wave- 
forms being blended. 

[0014] According to another aspect, the present invention provides an apparatus for synthesizing speech in response 
to a text, comprising: 

70 

means for translating text to a sequence of sound segment codes; 

means, responsive to sound segment codes in the sequence, for decoding the sequence of sound segment codes 
to produce strings of digital frames of a plurality of samples representing sounds for respective sound segment 
codes in the sequence, wherein the identified strings of digital frames have beginnings and endings; 
'5 means for concatenating a first digital frame at the ending of an identified string of digital frames of a particular 

sound segment code in the sequences with a second digital frame at the beginning an identified string of digital 
frames of an adjacent sound segment code in the sequence to produce a speech data sequence, including 
a buffer store to store the samples of first and second digital frames; 

means, coupled to the buffer store, for determining a blend point for the first and second digital frames in response 
?<? to magnitudes of samples in the first and second digital frames; and 

blending means, coupled with the buffer store and the means for determining, for computing a digital sequence 
representing a concatenation of the first and second sound segments in response to the first frame, the second 
frame and the blend point; and 

an audio transducer, coupled to the means for concatenating, to generate synthesized speech in response to the 
?5 speech data sequence. 



[0015] In one embodiment of the invention, the resources that determine the optimum blend point include computing 
resources that compute an extended frame comprising a discontinuity smoothed concatenation of the first digital frame 
with a replica of the first digital frame. Further resources find a subset of the extended frame with a minimum average 

30 magnitude difference between the samples in the subset and in the second digital frame and define the optimum blend 
point as the first sample in the subset. The blending resources include software or other computing resources that 
supply a first set of samples derived from the first digital frame and the blend point as a first segment of the digital 
sequence. Next, the second digital frame is combined with the subset of the extended frame, with emphasis on the 
subset of the extended frame in a starting sample and emphasis on the second digital frame in an ending sample to 

35 produce a second segment of the digital sequence. The first segment and second segment are combined produce the 
speech data sequence. 

[0016] According to yet further preferred embodiments of the present invention, the text-to-speech apparatus in- 
cludes a processing module for adjusting the pitch and duration of the identified strings of digital frames in the speech 
data sequence in response to the input text. Also, the decoder is based on a vector quantization technique which 
to provides excellent quality compression with very small decoding resources required. 

[0017] Other aspects and advantages of the present invention can be seen upon review of the figures, the detailed 
description, of preferred embodiments, given by way of example only, and the claims which follow. 
[0018] Fig. 1 is a block diagram of a generic hardware platform incorporating a text-to-speech system according to 
the present invention. 

45 [0019] Fig. 2 is a flow chart illustrating a basic text-to-speech routine according to the present invention. 

[0020] Fig. 3 illustrates the format of diphone records according to one embodiment of the present invention. 

[0021] Fig. 4 is a flow chart illustrating an encoder for speech data according to the present invention. 

[0022] Fig. 5 is a graph discussed in reference to the estimation of pitch filter parameters in the encoder of Fig. 4. 

[0023] Fig. 6 is a flow chart illustrating the full search used in the encoder of Fig. 4. 
50 [0024] Fig. 7 is a flow chart illustrating a decoder for speech data according to the present invention. 

[0025] Fig. 8 is a flowchart illustrating a technique for blending the beginning and ending of adjacent diphone records. 

[0026] Fig. 9 consists of a set of graphs referred to in explanation of the blending technique of Fig. 8. 

[0027] Fig. 1 0 is a graph illustrating a typical pitch versus time diagram for a sequence of frames of speech data. 

[0028] Fig. 11 is a flow chart illustrating a technique for increasing the pitch period of a particular frame. 
55 [0029] Fig. 1 2 is a set of graphs referred to in explanation of the technique of Fig. 1 1 . 

[0030] Fig. 1 3 is a flow chart illustrating a technique for decreasing the pitch period of a particular frame. 

[0031] Fig. 1 4 is a set of graphs referred to in explanation of the technique of Fig. 1 3. 

[0032] Fig. 15 is a flow chart illustrating a technique for inserting a pitch period between two frames in a sequence. 
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[0033] Fig. 16 is a set of graphs referred to in explanation of the technique of Fig. 15. 

[0034] Fig. 17 is a flow chart illustrating a technique for deleting a pitch period in a sequence of frames. 

[0035] Fig. 18 is a set of graphs referred to in explanation of the technique of Fig. 17. 

[0036] A detailed description of preferred embodiments of the present invention is provided with reference to the 
5 figures. Figs. 1 and 2 provide an overview of a system incorporating the present invention. Fig. 3 illustrates the basic 
manner in which diphone records are stored according to the present invention. Figs. 4-6 illustrate encoding methods 
based on vector quantization of the present invention. Fig. 7 illustrates a decoding algorithm according to the present 
invention. 

[0037] Figs. 8 and 9 illustrate a preferred technique for blending the beginning and ending of adjacent diphone 
10 records. Figs. 10-18 illustrate the techniques for controlling the pitch and duration of sounds in the text-to-speech 
system. 

I. System Overview (Figs. 1-3) 

75 [0038] Fig. 1 illustrates a basic microcomputer platform incorporating a text-to-speech system based on vector quan- 
tization according to the present invention. The platform includes a central processing unit 10 coupled to a host system 
bus 11 . A keyboard 12 or other text input device is provided in the system. Also, a display system 1 3 is coupled to the 
host system bus. The host system also includes a non-volatile storage system such as a disk drive 14. Further, the 
system includes host memory 15. The host memory includes text-to-speech (TTS) code, including encoded voice 

20 tables, buffers, and other host memory. The text-to-speech code is used to generate speech data for supply to an audio 
output module 1 6 which includes a speaker 1 7. The code also includes an optimum blend point, diphone concatenation 
routine as described in detail with reference to Figs. 8 and 9. 

[0039] According to the present invention, the encoded voice tables include a TTS dictionary which is used to translate 
text to a string of diphones. Also included is a diphone table which translates the diphones to identified strings of 
25 quantization vectors. A quantization vector table is used for decoding the sound segment codes of the diphone table 
into the speech data for audio output. Also, the system may include a vector quantization table for encoding which is 
loaded into the host memory 1 5 when necessary. 

[0040] The platform illustrated in Fig. 1 represents any generic microcomputer system, including a Macintosh based 
system, an DOS based system, a UNIX based system or other types of microcomputers. The text-to-speech code and 

30 encoded voice tables according to the present invention for decoding occupy a relatively small amount of host memory 
15. For instance, a text-to-speech decoding system according to the present invention may be implemented which 
occupies less than 640 kilobytes of main memory, and yet produces high quality, natural sounding synthesized speech. 
[0041] The basic algorithm executed by the text-to-speech code is illustrated in Fig. 2. The system first receives the 
input text (block 20). The input text is translated to diphone strings using the TTS dictionary (block 21). At the same 

35 time, the input text is analyzed to generate intonation control data, to control the pitch and duration of the diphones 
making up the speech (block 22). 

[0042] After the text has been translated to diphone strings, the diphone strings are decompressed to generate vector 
quantized data frames (block 23). After the vector quantized (VQ) data frames are produced, the beginnings and 
endings of adjacent diphones are blended to smooth any discontinuities (block 24). Next, the duration and pitch of the 

40 diphone VQ data frames are adjusted in response to the intonation control data (block 25 and 26). Finally, the speech 
data is supplied to the audio output system for real time speech production (block 27). For systems having sufficient 
processing power, an adaptive post filter may be applied to further improve the speech quality. 
[0043] The TTS dictionary can be implemented using any one of a variety of techniques known in the art. According 
to the present invention, diphone records are implemented as shown in Fig. 3 in a highly compressed format. 

45 [0044] As shown in Fig. 3, records for a left diphone 30 and a record for a right diphone 31 are shown. The record 
for the left diphone 30 includes a count 32 of the number NL of pitch periods in the diphone. Next, a pointer 33 is 
included which points to a table of length NL storing the number LPj for each pitch period, i goes from 0 to NL-1 of 
pitch values for corresponding compressed frame records. Finally, pointer 34 is included which points to a table 36 of 
ML vector quantized compressed speech records, each having a fixed set length of encoded frame size related to 

50 nominal pitch of the encoded speech for the left diphone. The nominal pitch is based upon the average number of 
samples for a given pitch period for the speech data base. 

[0045] A similar structure can be seen for the right diphone 31 . Using vector quantization, a length of the compressed 
speech records is very short relative to the quality of the speech generated. 

[0046] The format of the vector quantized speech records can be understood further with reference to the frame 
55 encoder routine and the frame decoder routine described below with reference to Figs. 4-7. 
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II. The Encoder/Decoder Routines (Figs. 4-7) 

[0047] The encoder routine is illustrated in Fig. 4. The encoder accepts as input a frame s n of speech data. In the 
preferred system, the speech samples are represented as 1 2 or 16 bit two's complement numbers, sampled at 22,252 

s Hz. This data is divided into non-overlapping frames s n having a length of N, where N is referred to as the frame size. 
The value of N depends on the nominal pitch of the speech data. If the nominal pitch of the recorded speech is less 
than 165 samples (or 135 Hz), the value of N is chosen to be 96. Otherwise a frame size of 160 is used. The encoder 
transforms the N-point data sequence s n into a byte stream of shorter length, which depends on the desired compres- 
sion rate. For example, if N = 160 and very high data compression is desired, the output byte stream can be as short 

10 as 12 eight bit bytes. A block diagram of the encoder is shown in Fig. 4. 

[0048] Thus, the routine begins by accepting a frame s n (block 50). To remove low frequency noise, such as DC or 
60 Hz power line noise, and produce offset free speech data, signal s n is passed through a high pass filter. A difference 
equation used in a preferred system to accomplish this is set out in Equation 1 for 0 < n < N. 
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X n = s n" s n-1 +0.999%., Equation 1 

[0049] The value x n is the "offset free" signal. The variables s.-, and x.-, are initialized to zero for each diphone and 
are subsequently updated using the relation of Equation 2. 



x.t = x N and s 0 = s N Equation 2 

[0050] This step can be referred to as offset compensation or DC removal (block 51). 

[0051] In order to partially decorrelate the speech samples and the quantization noise, the sequence is passed 
through a fixed first order linear prediction filter. The difference equation to accomplish this is set forth in Equation 3. 

y n = x n - 0.875 * x n .., Equation 3 

[0052] The linear prediction filtering of Equation 3 produces a frame y n (block 52). The filter parameter, which is 
equal to 0.875 in Equation 3, will have to be modified if a different speech sampling rate is used. The value of x^ is 
initialized to zero for each diphone, but will be updated in the step of inverse linear prediction filtering (block 60) as 
described below. 

[0053] It is possible to use a variety of filter types, including, for instance, an adaptive filter in which the filter param- 
eters are dependent on the diphones to be encoded, or higher order filters. 

[0054] The sequence y n produced by Equation 3 is then utilized to determine an optimum pitch value, P opt , and an 
associated gain factor, (3. P opt is computed using the functions s^P) s xx (P), s^P), and the coherence function Coh 
(P) defined by Equations 4, 5, 6 and 7 as set out below. 

N-1 

s (P) = X y n * PBUF p D 
n=0 nnax 

Equation 4 



N-1 

s (P) = Z y * y 
n = 0 



Equation 5 
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N-1 

s (P) = I PBUF p *PBUF p . p + n 

* YV n = 0 max r ^ n r max r * n 

Equation 6 

to and 

Coh(P) = Sxy (P) * s xy (P)/( Sxx (P) * Syy (P)) Equation 7 

75 [0055] PBUF is a pitch buffer of size P max , which is initialized to zero, and updated in the pitch buffer update block 
59 as described below. P opt is the value of P for which Coh(P) is maximum and (P) is positive. The range of P 
considered depends on the nominal pitch of the speech being coded. The range is (96 to 350) if the frame size is equal 
to 96 and is (160 to 414) if the frame size is equal to 160. P max is 350 if nominal pitch is less than 160 and is equal to 
414 otherwise. The parameter P opt can be represented using 8 bits. 

[0056] The computation of P opl can be understood with reference to Fig. 5. In Fig. 5, the buffer PBUF is represented 
by the sequence 100 and the frame y n is represented by the sequence 101 . In a segment of speech data in which the 
preceding frames are substantially equal to the frame y n , PBUF and y n will look as shown in Fig. 5. P op1 will have the 
value at point 102, where the vector y n 101 matches as closely as possible a corresponding segment of similar length 
in PBUF 100. 

[0057] The pitch filter gain parameter p is determined using the expression of Equation 8. 
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P= s xy( P o P t) 1 s yy( P o P i>- Equation 8 

[0058] (3 is quantized to four bits, so that the quantized value of P can range from 1/16 to 1 , in steps of 1/16. 
[0059] Next, a pitch filter is applied (block 54). The long term correlations in the pre-emphasized speech data y n are 
removed using the relation of Equation 9. 

35 r n = y n - ^PBUFp^.p^^ 0 < n < N. Equation 9 

[0060] This results in computation of a residual signal r n . 

[0061] Next, a scaling parameter G is generated using a block gain estimation routine (block 55). In order to increase 
4Q the computational accuracy of the following stages of processing, the residual signal r n is rescaled. The scaling pa- 
rameter, G, is obtained by first determining the largest magnitude of the signal r n and quantizing it using a 7-level 
quantizer. The parameter G can take one of the following 7 values: 256, 512, 1024, 2048, 4096, 8192, and 16384. The 
consequence of choosing these quantization levels is that the rescaling operation can be implemented using only shift 
operations. 

45 [0062] Next the routine proceeds to residual coding using a full search vector quantization code (block 56). In order 
to code the residual signal r n , the n point sequence r n is divided into non-overlapping blocks of length M, where M is 
referred to as the "vector size". Thus, M sample blocks by are created, where i is an index from zero to M-1 on the 
block number, and j is an index from zero to N/M-1 on the sample within the block. Each block may be defined as set 
out in Equation 10. 



50 



b ij = W (° ^ ' < N/ M and j < 0 < M) Equation 10 



[0063] Each of these M sample blocks b> Sj will be coded into an 8 bit number using vector quantization. The value of 
55 M depends on the desired compression ratio. For example, with M equal to 16, very high compression is achieved (i. 
e., 16 residual samples are coded using only 8 bits). However, the decoded speech quality can be perceived to be 
somewhat noisy with M=16. On the other hand, with M=2, the decompressed speech quality will be very close to that 
of uncompressed speech. However the length of the compressed speech records will be longer. The preferred imple- 
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mentation, the value M can take values 2, 4, 8, and 16. 

[0064] The vector quantization is performed as shown in Fig. 6. Thus, for all blocks by a sequence of quantization 
vectors is identified (block 1 20). First, the components of block b^ are passed through a noise shaping filter and scaled 
as set out in Equation 11 (block 121). 

5 

w j = 0.875 * w H - 0.5 * w h2 + 0.4375 * + b... 



0^j<M 

10 

v ij = G*w j 0<j<M Equation 11 



[0065] Thus, Vy is the jth component of. the vector Vj, and the values w. 1( w. 2 and w. 3 are the states of the noise 
shaping filter and are initialized to zero for each diphone. The filter coefficients are chosen to shape the quantization 
noise spectra in order to improve the subjective quality of the decompressed speech. After each vector is coded and 
decoded, these states are updated as described below with reference to blocks 124-126. 

[0066] Next, the routine finds a pointer to the best match in a vector quantization table (block 122). The vector 
quantization table 123 consists of a sequence of vectors C 0 through C 255 (block 123). 

[0067] Thus, the vector Vj is compared against 256 M-point vectors, which are precomputed and stored in the code 
table 1 23. The vector C qj which is closest to Vj is determined according to Equation 1 2. The value C p for p = 0 through 
255 represents the p ,h encoding vector from the vector quantization code table 1 23. 
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M-1 

min Z (v.. - C .) 2 
P J=0 

Equation 12 

[0068] The closest vector C qj can also be determined efficiently using the technique of Equation 1 3. 

v i T ' c qi * v i T * C P for a " P(0<p<255) Equation 1 3 

In Equation 1 3, the value vT represents the transpose of the vector v, and "•" represents the inner product operation 
in the inequality. 

[0069] The encoding vectors C p in table 1 23 are utilized to match on the noise filtered value Vg. However in decoding, 
a decoding vector table 1 25 is used which consists of a sequence of vectors QV p . The values QV p are selected for the 
purpose of achieving quality sound data using the vector quantization technique. Thus, after finding the vector C qi , the 
pointer q is utilized to access the vector QV qj . The decoded samples corresponding to the vector bj which is produced 
at step 55 of Fig. 4, is the M-point vector (1/G) * QV qi . The vector C p is related to the vector QV p by the noise shaping 
filter operation of Equation 1 1 . Thus, when the decoding vector QV p is accessed, no inverse noise shaping filter needs 
to be computed in the decode operation. The table 125 of Fig. 6 thus includes noise compensated quantization vectors. 
[0070] In continuing to compute the encoding vectors for the vectors by which make up the residual signal r n> the 
decoding vector of the pointer to the vector bj is accessed (block 1 24). That decoding vector is used for filter and PBUF 
updates (block 126). 

[0071] For the noise shaping filter, after the decoded samples are computed for each sub-block b h the error vector 
(b r QV qi ) is passed through the noise shaping filter as shown in Equation 14. 

W. = 0.875 * W H - 0.5 * W h2 + 0.4375 * W.. 3 + [b y - QV qj (j)] 

0<j<M Equation 14 

[0072] In Equation 1 4, the value QV qj (j) represents the j th component of the decoding vector QV qi . The noise shaping 
filter states for the next block are updated as shown in Equation 1 5. 
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w -1 


= W M-1 


W. 2 


= W M-2 


W -3 


= W M-3 



Equation 15 

[0073] This coding and decoding is performed for all of the N/M sub-blocks to obtain N/M indices to the decoding 
vector table 125. This string of indices Q n , for n going from zero to N/M-1 represent identifiers for a string of decoding 
vectors for the residual signal r n . 

[0074] Thus, four parameters represent the N-point data sequence y n : 

1) Optimum pitch, P opt (8 bits), 

2) Pitch filter gain, p (4 bits), 

3) Scaling parameter, G (3 bits), and 

4) A string of decoding table indices, Q n (0 £ n < N/M). 

[0075] The parameters p and G can be coded into a single byte. Thus, only (N/M) plus 2 bytes are used to represent 
N samples of speech. For example, suppose nominal pitch is 100 samples long, and M = 16. In this case, a frame of 
96 samples of speech are represented by 8 bytes: 1 byte for P opt , 1 byte for (3 and G, and 6 bytes for the decoding 
table indices Q ft . If the uncompressed speech consists of 16 bit samples, then this represents a compression of 24:1. 
[0076] Back to Fig. 4, four parameters identifying the speech data are stored (block 57). In a preferred system, they 
are stored in a structure as described with respect to Fig. 3 where the structure of the frame can be characterized as 
follows: 



#define NumOfVectorsPerFrame (FrameSize / VectorSize) 

struct frame { 

unsigned Gain : 4; 

unsigned Beta : 3; 

unsigned UnusedBit: 1; 

unsigned char Pitch ; 

unsigned char VQcodesINumOfVectorsPerFrame]; }; 



[0077] The diphone record of Fig. 3 utilizing this frame structure can be characterized as follows: 

DiphoneRecord 
{ 

char LeftPhone, RightPhone; 

short LeftPitchPeriodCountRightPitchPeriodCount; 

short *LeftPeriods, *RightPeriods; 

struct frame *LeftData, *RightData; 

} 

[0078] These stored parameters uniquely provide for identification of the diphones required for text-to-speech syn- 
thesis. 

[0079] As mentioned above with respect to Fig. 6, the encoder continues decoding the data being encoded in order 
to update the filter and PBUF values. The first step involved in this is an inverse pitch filter (block 58). With the vector 
r' n corresponding to the decoded signal formed by concatenating the string of decoding vectors to represent the residual 
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signal r' n , the inverse filter is implemented as set out in Equation 16. 

y' n = r' n + (3 * PBUF Pmax . Popt+ n , 0 S n < N. Equation 16 

5 

[0080] Next, the pitch buffer is updated (block 59) with the output of the inverse pitch filter. The pitch buffer PBUF is 
updated as set out in Equation 17. 

to PBUF n = PBUF (n + N) 0<n<(P max -N) 

PBUF (Pmax - N + n) = V'n 0 * n < N Equation 1 7 
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[0081] Finally, the linear prediction filter parameters are updated using an inverse linear prediction filter step (block 
60). The output of the inverse pitch filter is passed through a first order inverse linear prediction filter to obtain the 
decoded speech. The difference equation to implement this filter is set out in Equation 18. 

x' n = 0.875 * x 1 ^ + y' n Equation 18 

[0082] In Equation 18, x' n is the decompressed speech. From this, the value of x^ for the next frame is set to the 
value x N for use in the step of block 52. 

[0083] Fig. 7 illustrates the decoder routine. The decoder module accepts as input (N/M) + 2 bytes of data, generated 
by the encoder module, and applies as output N samples of speech. The value of N depends on the nominal pitch of 
the speech data and the value of M depends on the desired compression ratio. 

[0084] In software only text-to-speech systems, the computational complexity of the decoder must be as small as 
possible to ensure that the text-to-speech system can run in real time even on slow computers. A block diagram of the 
decoder is shown in Fig. 7. 

[0085] The routine starts by accepting diphone records at block 200. The first step involves parsing the parameters 
G, P, P opt) and the vector quantization string Q n (block 201 ). Next, the residual signal r' n is decoded (block 202). This 
involves accessing and concatenating the decoding vectors for the vector quantization string as shown schematically 
at block 203 with access to the decoding vector table 1 25. 

[0086] After the residual signal r* n is decoded, an inverse pitch filter is applied (block 204). This inverse pitch filter is 
implemented as shown in Equation 1 9: 



y'n 55 r 'n + P* SPBUF ( P max " P opt + n), 0 < n < N. Equation 19 

4Q SPBUF is a synthesizer pitch buffer of length P max initialized as zero for each diphone, as described above with respect 
to the encoder pitch buffer PBUF. 

[0087] For each frame, the synthesis pitch buffer is updated (block 205). The manner in which it is updated is shown 
in Equation 20: 

45 SPBUF n = SPBUF (n + N) 0<n<(P max -N) 

SPBUF (Pmax - N + n) = V„ °<n<N Equation 20 

so [0088] After updating SPBUF, the sequence y' n is applied to an inverse linear prediction filtering step (block 206). 
Thus, the output of the inverse pitch filter y' n is passed through a first order inverse linear prediction filter to obtain the 
decoded speech. The difference equation to implement the inverse linear prediction filter is set out in Equation 21 : 



x' n = 0.875 * x'^ + y' n Equation 21 

[0089] In Equation 21, the vector x' n corresponds to the decompressed speech. This filtering operation can be im- 
plemented using simple shift operations without requiring any multiplication. Therefore, it executes very quickly and 



9 



EP 0 680 652 B1 



utilizes a very small amount of the host computer resources. 

[0090] Encoding and decoding speech according to the algorithms described above, provide several advantages 
over prior art systems. First, this technique offers higher speech compression rates with decoders simple enough to 
be used in the implementation of software only text-to-speech systems on computer systems with low processing 
s power. Second, the technique offers a very flexible trade-off between the compression ratio and synthesizer speech 
quality. A high-end computer system can opt for higher quality synthesized speech at the expense of a bigger RAM 
memory requirement. 

III. Waveform Blending For Discontinuity Smoothing (Figs. 8 and 9) 

10 

[0091] As mentioned above with respect to Fig. 2, the synthesized frames of speech data generated using the vector 
quantization technique may result in slight discontinuities between diphones in a text string. Thus, the text-to-speech 
system provides a module for blending the diphone data frames to smooth such discontinuities. The blending technique 
of the preferred embodiment is shown with respect to Figs. 8 and 9. 
15 [0092] Two concatenated diphones will have an ending frame and a beginning frame. The ending frame of the left 
diphone must be blended with the beginning frame of the right diphone without audible discontinuities or clicks being 
generated. Since the right boundary of the first diphone and the left boundary of the second diphone correspond to 
the same phoneme in most situations, they are expected to be similar looking at the point of concatenation. However, 
because the two diphone codings are extracted from different context, they will not look identical. This blending tech- 
no nique is applied to eliminate discontinuities at the point of concatenation. In Fig. 9, the last frame, referring here to one 
pitch period, of the left diphone is designated L n (0 < n < PL) at the top of the page. The first frame (pitch period) of 
the right diphone is designated R n (0 < n < PR). The blending of L n and R n according to the present invention will alter 
these two pitch periods only and is performed as discussed with reference to Fig. 8 . The waveforms in Fig. 9 are chosen 
to illustrate the algorithm, and may not be representative of real speech data. 
25 [0093] Thus, the algorithm as shown in Fig. 8 begins with receiving the left and right diphone in a sequence (block 
300). Next, the last frame of the left diphone is stored in the buffer L n (block 301). Also, the first frame of the right 
diphone is stored in buffer R n (block 302). 

[0094] Next, the algorithm replicates and concatenates the left frame L n to form extend frame (block 303). In the next 
step, the discontinuities in the extended frame between the replicated left frames are smoothed (block 304). This 
30 smoothed and extended left frame is referred to as El n in Fig. 9. 

[0095] The extended sequence El n (0 < n < 2*PL) is obtained in the first step as shown in Equation 22: 



El n =L n n = 0,1,...,PL-1 

35 

EI PL + n = L n n = 0.1.....PL-1 Equation 22 



40 



Then discontinuity smoothing from the point n = PL is conducted according to the filter of Equation 23: 

E, PUn = EI PUn + t EI (PL-1) " ^(PH)]**"* 1 • 

n = 0.1,...,(PL/2). Equation 23 



In Equation 23, the value A is equal to 15/16 and EP (PL-1) = El 2 + 3 * (El r EI 0 ). Thus, as indicated in Fig. 9, the extended 
sequence El n is substantially equal to L n on the left hand side, has a smoothed region beginning at the point PL and 
converges on the original shape of L n toward the point 2PL. If L n was perfectly periodic, then Elp^ = El'p^. 
[0096] In the next step, the optimum match of R n with the vector El n is found. This match point is referred to as P opt . 
(Block 305.) This is accomplished essentially as shown in Fig. 9 by comparing with El n to find the section of El n 
which most closely matches R n . This optimum blend point determination is performed using Equation 24 where W is 
the minimum of PL and PR, and AMDF represents the average magnitude difference function. 
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W-1 

AMDF(p) = I | El n + p -R n | 

n = 0 Equation 24 

[0097] This function is computed for values of p in the range of 0 to PL-1 . The vertical bars in the operation denote 
io the absolute value. W is the window size for the AMDF computation. P opt is chosen to be the value at which AMDF(p) 
is minimum. This means that p = P opt corresponds to the point at which sequences El n + p (0<n<W) and R n (0 < n < W) 
are very close to each other. 

[0098] After determining the optimum blend point P op|I the waveforms are blended (block 306). The blending utilizes 
a first weighting ramp WL which is shown in Fig. 9 beginning at P opt in the El n trace. In a second ramp, WR is shown 
15 in Fig. 9 at the R n trace which is lined up with P opt . Thus, in the beginning of the blending operation, the value of El n 
is emphasized. At the end of the blending operation, the value of R n is emphasized. 

[0099] Before blending, the length PL of L n is altered as needed to ensure that when the modified L n and R n are 
concatenated, the waveforms are as continuous as possible. Thus, the length P'L is set to P opl if P opl is greater than 
PL/2. Otherwise, the length P'L is equal to W + P opt and the sequence L n is equal to El n for 0 < n £ (Pl-1 ). 
20 [0100] The blending ramp beginning at P opl is set out in Equation 25: 

R n = El n + Popt + ( R n " El n + Popt>*( n +1 )™ 
25 R n = R n W<n<PR Equation 25 



[0101] Thus, the sequences L„ and R n are windowed and added to get the blended R n . The beginning of L n and the 
ending of R n are preserved to prevent any discontinuities with adjacent frames. 

[0102] This blending technique is believed to minimize blending noise in synthesized speech produced by any con- 
30 catenated speech synthesis. 

IV. Pitch and Duration Modification (Figs. 10-18) 

[0103] As mentioned above with respect to Fig. 2, a text analysis program analyzes the text and determines the 
35 duration and pitch contour of each phone that needs to be synthesized and generates intonation control signals. A 
typical control for a phone will indicate that a given phoneme, such as AE, should have a duration of 200 milliseconds 
and a pitch should rise linearly from 220Hz to 300Hz. This requirement is graphically shown in Fig. 10. As shown in 
Fig. 1 0, T equals the desired duration (e.g. 200 milliseconds) of the phoneme. The frequency f b is the desired beginning 
pitch in Hz. The frequency f e is the desired ending pitch in Hz. The labels P 1f P 2 ...,P 6 indicate the number of samples 
40 of each frame to achieve the desired pitch frequencies f b , f 2 ...,f e . The relationship between the desired number of 
samples, P jt and the desired pitch frequency fj (^ = f b ), is defined by the relation: 

Pi = Fg/fj, where F s is the sampling frequency for the data. 
As can be seen in Fig. 10, the pitch period for a lower frequency period of the phoneme is longer than the pitch period 
for a higher frequency period of the phoneme. If the nominal frequency were P 3 , then the algorithm would be required 
45 to lengthen the pitch period for frames and P 2 and decrease the pitch periods for frames P 4 , P 5 and P 6 . Also, the 
given duration T of the phoneme will indicate how many pitch periods should be inserted or deleted from the encoded 
phoneme to achieve the desired duration period. Figs. 11 through 18 illustrate a preferred implementation of such 
algorithms. 

[0104] Fig. 11 illustrates an algorithm for increasing the pitch period, with reference to the graphs of Fig. 12. The 
50 algorithm begins by receiving a control to increase the pitch period to N+A, where N is the pitch period of the encoded 
frame. (Block 350). In the next step, the pitch period data is stored in a buffer x n (block 351). x n is shown in Fig. 12 at 
the top of the page. In the next step, a left vector is generated by applying a weighting function WL to the pitch 
period data x n with reference to A (block 352). This weighting function is illustrated in Equation 26 where M = N-A: 

55 

L n = x n for0<n<A 
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L n = x n * (N-n)/(M+1 ) for A < n < N Equation 26 

As can be seen in Fig. 12, the weighting function WL is constant from the first sample to sample A, and decreases 
5 from A to N. 

[0105] Next, a weighting function WR is applied to x n (block 353) as can be seen in the Fig. 12. This weighting 
function is executed as shown in Equation 27: 

to R n = X n + A *< n+1 V( M+1 ) for 0<n<N-A 

R n = X n+A for N-A<n<N. Equation 27 
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[0106] As can be seen in Fig. 1 2, the weighting function WR increases from 0 to N-A and remains constant from N- 
A to N. The resulting waveforms L n and R n are shown conceptually in Fig. 12. As can be seen, L n maintains the 
beginning of the sequence x n , while R n maintains the ending of the data x n . 

[0107] The pitch modified sequence y n is formed (block 354) by adding the two sequences as shown in Equation 28: 

20 y n = L n + R (n . A) Equation 28 

This is graphically shown in Fig. 12 by placing R n shifted by A below L n . The combination of L n and R n shifted by A is 
shown to be y n at the bottom of Fig. 1 2. The pitch period for y n is N+A. The beginning of y n is the same as the beginning 
of x n , and the ending of y n is substantially the same as the ending of x n . This maintains continuity with adjacent frames 
in the sequence, and accomplishes a smooth transition while extending the pitch period of the data. 
[0108] Equation 28 is executed with the assumption that !_„ is 0, for n<N, and R n is 0 for n<0. This is illustrated 
pictorially in Fig. 12. 

[0109] An efficient implementation of this scheme which requires at most one multiply per sample, is shown in Equa- 
tion 29: 

y n = x n 0<n<A 

V n = X n + t X n-A - X nH n - A+1 MN-A+1 ) A<n<N 
V n ~ X n-A 

N<n<N d Equation 29 

40 

This results in a new pitch period having a pitch period of N+A. 

[0110] There are also instances in which the pitch period must be decreased. The algorithm for decreasing the pitch 
period is shown in Fig. 13 with reference to the graphs of Fig. 14. Thus, the algorithm begins with a control signal 
indicating that the pitch period must be decreased to N-A. (Block 400). The first step is to store two consecutive pitch 
45 periods in the buffer x n (block 401). Thus, the buffer x n as can be seen in Fig. 14 consists of two consecutive pitch 
periods, with the period N, being the length of the first pitch period, and N r being the length of the second pitch period. 
Next, two sequences L n and R n are conceptually created using weighting functions WL and WR (blocks 402 and 403). 
The weighting function WL emphasizes the beginning of the first pitch period, and the weighting function WR empha- 
sizes the ending of the second pitch period. These functions can be conceptually represented as shown in Equations 
30 and 31 , respectively: 
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L n =x n for0<n<N,-W 



L n = x n *(N,-n)/(W+1) W<n<N, 

L n = 0 otherwise. Equation 30 



12 



EP 0 680 652 B1 



and 

R n = x n * (n-N,+W- A+1 )/(W+1 ) for N,-W+A<n<N,+A 
R = x n for N,+A<n<N,+N r 

R n = 0 otherwise. Equation 31 

[0111] In these equations, A is equal to the difference between N, and the desired pitch period N d . The value W is 
equal to 2*A, unless 2*A is greater than N d , in which case W is equal to N d . 

[0112] These two sequences t^ and R n are blended to form a pitch modified sequence y n (block 404). The length 
of the pitch modified sequence y n will be equal to the sum of the desired length and the length of the right phoneme 
frame N r . It is formed by adding the two sequences as shown in Equation 32: 

v n = L n +R ( n + A) Equation 32 

[0113] Thus, when a pitch period is decreased, two consecutive pitch periods of data are affected, even though only 
the length of one pitch period is changed. This is done because pitch periods are divided at places where short-term 
energy is the lowest within a pitch period. Thus, this strategy affects only the low energy portion of the pitch periods. 
This minimizes the degradation in speech quality due to the pitch modification. It should be appreciated that the draw- 
ings in Fig. 14 are simplified and do not represent actual pitch period data. 

[0114] An efficient implementation of this scheme, which requires at most one multiply per sample, is set out in 
Equations 33 and 34. 

[0115] The first pitch period of length N d is given by Equation 33: 

y n = x n 0<n<N r W 
Yn = x n + I x n + A " x n ]*(n-N,+W+1 )/(W+1 ) N r W<n<N d Equation 33 

[0116] The second pitch period of length N r is generated as shown in Equation 34: 

= X n-A + I X n * V J*(n-A-N |+ W+1 )/(W+1 ) 
N,<n<N,+A 

40 v n = x n N |+A <n<N | +N r Equation 34 

[0117] As can be seen in Fig. 14, the sequence is essentially equal to the first pitch period until the point N,-W. At 
that point, a decreasing ramp WL is applied to the signal to dampen the effect of the first pitch period. 

4S [0118] As also can be seen, the weighting function WR begins at the point N,-W + A and applies an increasing ramp 
to the sequence x n until the point N, + A. From that point, a constant value is applied. This has the effect of damping 
the effect of the right sequence and emphasizing the left during the beginning of the weighting functions, and generating 
an ending segment which is substantially equal to the ending segment of x„ emphasizing the right sequence and 
damping the left. When the two functions are blended, the resulting waveform y n is substantially equal to the beginning 

50 of x n at tne beginning of the sequence, at the point N,-W a modified sequence is generated until the point N,. From N, 
to the ending, sequence x n is shifted by A results. 

[0119] A need also arises for insertion of pitch periods to increase the duration of a given sound. A pitch period is 
inserted according to the algorithm shown in Fig. 15 with reference to the drawings of Fig. 16. 
[0120] The algorithm begins by receiving a control signal to insert a pitch period between frames !_„ and R n (block 
55 450). Next, both L n and R n are stored in the buffer (block 451 ), where L n and R n are two adjacent pitch periods of a 
voice diphone. (Without loss of generality, it is assumed for the description that the two sequences are of equal lengths 
N.) 

[0121] In order to insert a pitch period, x n of the same duration, without causing a discontinuity between L n and x n 
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and between x n and R n> the pitch period x n should resemble R n around n=0 (preserving L n to x n continuity), and should 
resemble L n around n=N (preserving x n to R n continuity). This is accomplished by defining x n as shown in Equation 35: 



70 



x n = R n + ( L n " R n> * t(n+1 )/(N+1 )] 0<n<N-1 Equation 35 

[0122] Conceptually, as shown in Fig. 15, the algorithm proceeds by generating a left vector WL(L n ), essentially 
applying to the increasing ramp WL to the signal L n . (Block 452). 

[0123] A right vector WR (R n ) is generated using the weighting vector WR (block 453) which is essentially a decreas- 
ing ramp as shown in Fig. 16. Thus, the ending of L n is emphasized with the left vector, and the beginning of R n is 
emphasized with the vector WR. 

[0124] Next, WR (L n ) and WR (R n ) are blended to create an inserted period x n (block 454). 

[0125] The computation requirement for inserting a pitch period is thus just a multiplication and two additions per 

speech sample. 

75 [0126] Finally, concatenation of L n , x n and R n produces a sequence with an inserted pitch period (block 455). 

[0127] Deletion of a pitch period is accomplished as shown in Fig. 17 with reference to the graphs of Fig. 18. This 
algorithm, which is very similar to the algorithm for inserting a pitch period, begins with receiving a control signal 
indicating deletion of pitch period R n which follows L n (block 500). Next, the pitch periods L n and R n are stored in the 
buffer (block 501). This is pictorially illustrated in Fig. 18 at the top of the page. Again, without loss of generality it is 

20 assumed that the two sequences have equal lengths N. 

[0128] The algorithm operates to modify the pitch period L n which precedes R n (to be deleted) so that it resembles 
R n , as n approaches N. This is done as set forth in Equation 36: 

25 L' n = L n + (R n - L n ) * [(n+1)/(N+1)] 0<n<N-1 Equation 36 

In Equation 36, the resulting sequence L' n is shown at the bottom of Fig. 18. Conceptually, Equation 36 applies a 
weighting function WL to the sequence L n (block 502). This emphasizes the beginning of the sequence L n as shown. 
Next, a right vector WR (R n ) is generated by applying a weighting vector WR to the sequence R n that emphasizes the 
ending of R n (block 503). 

[0129] WL (L n ) and WR (R n ) are blended to create the resulting vector L' n . (Block 504). Finally, the sequence L n -R n 
is replaced with the sequence L' n in the pitch period string. (Block 505). 
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IV. Conclusion 

[0130] Accordingly, the present invention presents a software only text-to-speech system which is efficient, uses a 
very small amount of memory, and is portable to a wide variety of standard microcomputer platforms. It takes advantage 
of knowledge about speech data, and to create a speech compression, blending, and duration control routine which 
produces very high quality speech with very little computational resources. 

[0131] A source code listing of the software for executing the compression and decompression, the blending, and 
the duration and pitch control routines is provided in the Appendix as an example of a preferred embodiment of the 
present invention. 

[0132] The foregoing description of preferred embodiments of the present invention has been provided for the pur- 
poses of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise forms 
disclosed. Obviously, many modifications and variations will be apparent to practitioners skilled in this art. The embod- 
iments were chosen and described in order to best explain the principles of the invention and its practical application, 
thereby enabling others skilled in the art to understand the invention for various embodiments and with various mod- 
ifications as are suited to the particular use contemplated. It is intended that the scope of the invention be defined by 
the following claims. 



14 



EP 0 680 652 B1 



APPENDIX 

©APPLE COMPUTER, INC. 1993 
37 C.F.R. §1. 96(a) 

COMPUTER PROGRAM LISTINGS 

[0133] 
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I. ENCODER MODULE 
[0134] 
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^include <stdio.h> 
^include <math.h> 
include <StdLib.h> 
10 ^include <types.h> 

^include <fcntl.h> 
^include < string. h> 

^include < types. h> 
is #include <files.h> 

^include <resources.h> 
#include < memory. h> 
^include "vqcoder.h" 

20 #define LAST_FRAME_FLAG 128 

#define PBUF_SIZE 440 

static float oc_statel2), nsf_stateINSF_ORDER + 1 ]; 

static short pstate|PORDER+ 1], dstate[PORDER + 1]; 

static short AnaPbuf[PBUF SIZE]; 
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static short vsize, cbook_size, bs_size; 

^pragma segment vqlib 

/• Read Code Books */ 
float *EncodeBook|MAX_CBOOK SIZE]; 
Short *DecodeBook[MAX~CBOOKf SIZE]; 
get_cbook(short ratio) 

{ 

short *p; 

short frame_size, i; 
static short last_ratio « 0; 



40 Handle h; 

int skip; 



h = GetResource('CBOKM); 

HLocMh); 

p = (short *) *h; 

if <ratio = = last_ratio) 

return; 
last_ratio = ratio; 



50 if (ratio < 3} 

return; 



if <NOMINAL_PITCH < 165) 
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frame_size = 96; 

else 

frame_size = 1 60; 

get_compr_pars(ratio, framesize, &vsize, &cbook size, &bs_size); 
skip = 0; 

while (p[skip + 1) != vsize) 
{ 

short t1, t2; 
t2 = plskip); 
t1 = plskip + 1 J; 

skip + = sizeof (float) * (2 * t2-1) * (tl + 1) / sizeof(short) 
+ (2 * t2 * t1 + 2); 

} 

/*Skip Binary search tree */ 

skip + = sizeof(float) * (cbook_size-1 ) # (vsize+1) / sizeof (short) 
+ (cbook_size * vsize + 2); 

/* Get pointers to Full search code books */ 
for (i « 0; i < cbook_size; i + +) 

{ 

EncodeBookp] = (float *) &p[skip); 

skip + = (vsize + 1 ) * sizeof (float) / sizeof(short); 

} 

for (i = 0; i < cbook size; i + + ) 
{ 

DecodeBook|i] = p + skip; 
skip + = vsize; 

} 



char *getcbook(long # len, short ratio) 
{ 

get_cbook(ratio); 

*len = sizeof(short) * vsize * cbook size; 

/* plus one is to make space at the end for the array of pointers •/ 
return (char*) DecodeBooklO]; 

} 

/* A Routine for Pitch filter parameter Estimation */ 

GetPitchFilterPars (x, len, pbuf, min pitch, max_pitch, pitch, beta) 

float *beta; 

short *x, *pbuf; 

short min_pitch, max pitch; 

short len; 

unsigned int * pitch; 

{ 

/* Estimate long-term predictor */ 
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int best_pitch, i, j; 

float syy, sxy, best_sxy = 0.0, best_syy = 1.0; 
short *ptr; 

best_pitch = minpitch; 
ptr = pbuf + PBUFSIZE - min_pitch; 
syy = 1.0; 
w for (i « 0; i < len; i+ + ) 

{ 

syy + = (*ptr) * Cptr); 
ptr + + ; 

} 

75 for (j = min_pitch; j < max_pitch; j + +) 

sxy = 0.0; 

ptr = pbuf + PBUF_SIZE - j; 
for (i = 0; i < len; i + + ) 

sxy 4- = x(i) * (*ptr+ +); 

if (sxy > 0 && (sxy * sxy * best_syy > best_sxy # best_sxy • syy)) 

best_syy = syy; 
best_sxy « sxy; 
best pitch = j; 

} 

syy = syy - pbuf [PBUF_SIZE - j + len - 1 ] * pbuflPBUF SIZE - j + len - 1 ) 
+ pbuf|PBUF_SIZE - j - 11 * pbuf[PBUF_SIZE - ]• 11; 



•pitch = best_pitch; 
35 'beta = best sxy / best_syy; 

} 

/• Quantization of LTP gain parameter •/ 
CodePitchFilterGain{beta, bcode) 
40 float beta; 

unsigned int * bcode; 

{ 

int i; 

for (i = 0; i < DLB TAB SIZE; i + + ) 
{ 

if (beta < = dlbjab[i]) 
break; 

} 

50 * bcode = i; 

} 

/• Pitch filter */ 

PitchFilter(data, len, pbuf, pitch, ibeta) 
55 float # data; 
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short ibeta; 

short # pbuf; 
short len; 
unsigned int pitch; 

{ 

long pn; 

int i,j; 



j = PBUF_SIZE - pitch; 
for (i = 0; i < len; i + +) 
{ 

pn = {(ibeta * pbuf(j+ +)) >> 4); 
datafi] -= pn; 

) 

} 

/• Forward Noise Shaping filter •/ 

FNSFilter{float *inp, float 'state, short len, float *out) 

short i, j; 

for (j = 0; j < len; j+ +) 
{ 

float tmp = inp[j]; 

for (i = 1 ; i < = NSFJDRDER; i + + ) 

tmp + » stateli] * nsflil; 
outljl = state[0] = tmp; 
for (i = NSF ORDER; i > 0; i«) 

state[il = state[i-1]; 

} 

} 

/ # Update Noise shaping Filter states */ 
UpdateNSFState{float *inp, float *state, short len) 

short i, j; 

float temp statelNSF^ORDER + 1 J; 

for <i = 0; i < = NSF ORDER; i+ + j 
temp_stateli] = 0; 

for (j = 0; j < len; j+ +) 
{ 

float tmp = inp[j); 

for (i = 1 ; i < = NSFJDRDER; i + + ) 
tmp + = temp_state[i] * nsffij; 

temp_state[0] = tmp; 

for (i = NSF ORDER; i > 0; i~) 
temp_state[i) - tempstatelM I; 
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} 

for (i = 0; i < = NSF ORDER; i + + ) 
state[il = stateli] - temp stateli]; 

} 

/• Quantization of Segment Power */ 
CodeBlockGainlpower, gcode) 
float power; 
unsigned int *gcode; 
{ 

int i; 

for <i = 0; i < DLG_TAB_SIZE; i+ + ) 
{ 

if (power < = dlgjabli]) 
break; 

} 

•gcode = i; 

} 

/• Full search Coder */ 

VQCodeMfioat *x, float *nsf_state, short len. struct frame *bs) 
{ 

fioat max_x, tmp; 

int i, j. k, index, lshift_count; 

unsigned int gcode; 

float min_err = 0; 

ma x_x = x[0); 
for (i = 1; i < len; i+ + ) 
if ( fabs(x[i)) > maxx) 
max_x = fabs(x[i)); 

CodeBlockGain{max_x, &gcode); 
max_x = qlg_tab[gcodel; 

lshift_count = 7 - gcode; /* To scale 14-bit Code book output to the 16-bit 

actual value */ 

bs-> gcode = gcode; 

for (i = 0; i < len; i + = vsize) 

{ 

/• Filter the data vector */ 
FNSFilter(&x[i|, nsf_state, vsize, &x[i)); 

/• Scale data */ 

for (j = i; j < i + vsize; j+ +) 
x[j) = xlj] * 1024 / max_x; 

index = 0; 

for (j = 0; j < cbook_size; j + +) 

{ 
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tmp = EncodeBook|j)|vsize] * 1024.0; 
for (k = 0; k < vsize; k+ + ) 

tmp -= x[i + k] • EncodeBook[j)|k]; 

if (tmp < min_err ( j j = = 0) 
{ 

index = j; 
min_err = tmp; 

} 

» 

bs->vqcodeli/vsize] = index; 

/* Rescale data: Decoded data is 14-bits, convert to 16 bits •/ 

if (lshift_count) 

{ 

for (k = 0; k < vsize; k+ +) 
^ xli + k] = ((4 * DecodeBooklindexlIk]) >> lshift_count); 

else 
{ 

for (k = 0; k < vsize; k+ +) 

x[i + k] = 4 * DecodeBook(index][k); 



I* Update noise shaping filter state */ 
UpdateNSFState(6tx[il, nsfjstate, vsize); 

} 

init compressO 

{ " 
int i; 

oc_state[0J = 0;; 
oc_state[11 = 0;; 
for (i = 0; i < = PORDER; 

pstateti] = dstate[i] = 0; 
for (i = 0; i < PBUF_SIZE; i + + ) 

AnaPbuf[i] = 0; 
for (i = 0; i < = NSF_ORDER; i+ + ) 

nsf stateli] = 0; 

} 

Encoderjxn, frame_size, min_pitch, max_pitch. bs) 
short xnl]; 
struct frame *bs; 

short frame_size, minpitch, max_pitch; 

unsigned int pitch, bcode; 

float preemp_xn[PBUF_SIZE], beta; 

short xn_copy|PBUF_SIZE); 
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short ibeta; 
float acc; 
int i, j; 



/* Offset Compensation */ 
for (j = 0; i < frame size; i + +) 

{ 

float inp = xn[i]; 

xn[i] = inp - oc_state[0] + ALPHA * oc_state[1|; 
oc_state[1 1 = xn[i); 
oc statelO] = inp; 

} 

/* Linear Prediction Filtering */ 
for (i = 0; i < frame_size; i + + ) 
{ 

acc = pstate[0] = xn[i); 

for (j = 1; j < = PORDER; j + +) 

acc -= pstatelj] * pfiltljj; 
xn copyli] = preempxnli] = acc; 
foMj = PORDER; j > 0; j-) 

pstate(jl = pstatelj- 11; 

} 

GetPitchFiiterPars (xncopy, frame_size, AnaPbuf, minpitch, 

max_pitch, &pitch, &beta); 
CodePitchFilterGain(beta f &bcode); 
ibeta = qlbjablbcode]; 

bs->bcode = bcode; 

bS-> pitch = pitch - min_pitch + 1; 

PitchFilter(preemp_xn, frame_size, AnaPbuf, pitch, ibeta); 

VQCoder(preemp_xn, nsfstate, framesize, bs); 

/• Inverse Filtering */ 

j = PBUF_SIZE - pitch; 

for (i = 0; i < frame_size; i + +) 

{ 

xn_copy|i) = preemp_xnli]; 

xn_copy|i) + = ((ibeta * AnaPbuf [j+ + ]) > > 4); 

} 

/• Update Pitch Buffer •/ 
j = 0; 

for (i = frame_size; i < PBUFSIZE; i-i- + ) 

AnaPbuf[j++] = AnaPbuf [i); 
for (i » 0: i < frame_size; i + + ) 
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AnaPbuf[j + + ] = xn_copy|i); 

/* Inverse LP filtering */ 

for (j = 0; i < frame_size; i + + ) 

{ 

acc = xn_copy[i]; 

for (j = 1; j < = PORDER; j + +) 

acc = acc + dstatelj] # pfilt(j); 
dstate[0J - acc; 
for (j = PORDER; j > 0; j-) 

dstatelj) = dstatelj-1); 



for (j = 0; j < - PORDER; j + + ) 
pstatefj] = dstatelj); 



compress (short 'input, short ilen. unsigned char 'output, long •olen, long docomp) 

irrt i, j, vcount; 

unsigned char temp; 

sh ° r t frame_size, min_pitch, max_pitch; 

if (docomp > 2) 
{ 

init_compress(); 

if (NOMINAL PITCH < 165) 
{ 

min_pitch = 96; 
framesize = 96; 
max_pitch = 350; 

} 

else 
{ 

min_pitch = 160; 
frame_size = 1 60; 
max_pitch =414; 

} 

bs_size = frame_size / vsize + 2; 

/• TEMPORARY: Storing State information V 

pstated] = * (input - 1); 

if (pstated I > 0) 

pstatell] = (pstatell] + 128)/ 256 + 128; 

else 

pstatell] = (pstated] - 128)/ 256 + 128; 

if (pstate[l I < 0) 
pstated] = 0; 
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if {pstateM] > 255) 
pstateM] .= 255; 
5 'output = pstateM I; 

i = 1; 

pstateM ] = pstatelU - 128; 
pstateM] = 256 * pstateM I; 
dstateM] = pstateM); 
10 r End of Hack •/ 

for (i = 0; i < ilen; i + = frame_size) 
{ 

EncodeMinput + i, frame_size, min_pitch, max_pitch, output + j); 
75 j + = bs_size; 

} 

j - = bs_size; 

/* Number of vectors in last frame */ 

20 

vcount = (ilen + f rame_size - i + vsize - 1 ) / vsize; 
temp = outputlj); 

outputlj] = vcount + LAST_FRAME_FLAG; 
outputlj + vcount + 21 « temp; 
25 # olen = j + vcount + 3; 

} 

else 

{ 

static long SampCount = 0; 
30 copy(input, output, 2*ilen); 

SampCount + = ilen; 
*olen = ilen; 

} 

} 

copy(a, b, len) 
short *a, # b; 
short len; 

40 | 

int i; 

for (i = 0; i < len; i + + ) 
# b++ = (*a++); 

} 
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II. DECODER MODULE 



[0135] 



5 



70 



^include <Types.h> 
^include < Memory. h> 
^include <Guickdraw.h> 
^include <ToolUtils.h> 
^include < errors. h> 



^include < files. h> 

^include "vtcint.h" 
^include <stdlib.h> 
#include <math.h> 
^include <sysequ.h> 
^include < string. h> 

^define MAX_CBOOK_SIZE 256 
^define LAST_FRAME_FLAG 1 28 

^define PORDER ~ 1 

^define IPCONS 7 /♦ 7/8 V 

#define LARGE IMUM 100000000 
^define VOICED 1 

#define LEFT 0 
#define RIGHT 1 
^define UNVOICED 0 

^define PFILTORDER 8 

struct frame { 
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unsigned gcode : 4; 
unsigned bcode : 4; 
unsigned pitch : 8; 
unsigned char vqcodeN; 
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void expand(short * 'DecodeBook, short framesize, short vsize, 
short minpitch, struct frame *bs, short "output, short smpnum); 
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case 4: 



•vsize = 2; 
'cbooksize = 256; 
*bs_size = frame_size/2 + 2; 
break; 
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case 7: 

* vsize = 4- 

*cbook_size = 256; 

*bs_size = frame_size/4 + 2; 

break; 
case 14: 

•vsize = 8; 

•cbook_size = 256; 

*bs_size = framesize/8 + 2; 

break; 
case 24: 

•vsize = 16; 

*cbook_size = 256; 

*bs_size = frame_size/l 6 + 2; 

break; 
default: 

•vsize = 2; 

*cbook_size = 256; 

*bs_size = frame_size/2 + 2; 

break; 

} 

} 

short *Snlnit(short comp_ratio) 
{ 

short # state, *ptr; 
int i; 

state = ptr = (short *)NewPtr((PFILT_ORDER + 1 + PFILT_ORDER/2 + 2) 
sizeof(short)); 

if ( state = = nil ) 

{ 

return nil; 

} 

for (i = 0;i<PFILT_ORDER+ 1;i+ +) 
•ptr+ + = o" 

/• 

if (comp_ratio = = 24) 
{ 

*ptr++ = 0.036953 * 32768 + 0.5; 
•ptr+ + = -0.132232 * 32768 - 0.5; 
*ptr++ = 0.047798 • 32768 + 0.5; 
•ptr++ - 0.403220 * 32768 + 0.5; 
•ptr+ + = 0.290033 * 32768 + 0.5; 

} 

else 
{ 

# ptr+ + = 0.074539 # 32768 + 0.5; 
# ptr+ + = -0.174290 • 32768 - 0.5; 
♦ptr + + = 0.013704 * 32768 + 0.5: 
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*ptr+ + = 0.426815 # 32768 + 0.5; 
♦ptr+ + = 0.320707 * 32768 + 0.5; 

} 

*/ 

if (compjcitio = = 24) 
{ 

•ptr+ + = 121 1; 
*ptr + + = -4333; 
*ptr + + = 1566; 
*ptr++ = 13213; 
*ptr + + = 9504; 

} 

else 
{ 

*ptr+ + = 2442; 
*ptr + + = -571 1; 
•ptr+ + = 449; 
*ptr + + = 13986; 
♦ptr + + = 10509; 

} 

•ptr = 0; /• DC value V 

return state; 

} 

SnDone(char * state) 
{ 

if ( state ! = nil ) 
{ 

DisposPtr(state); 

} 

} 

short ## SnDelnit(p, ratio, frame_size) 
short *p,ratio, frame size; 

{ 

int i; 

short cbook_size = 256, vsize = 16, bs_size; 
short ** DecodeBook; 



get_compr_pars(ratio, framesize, &vsize, &cbook_size, &bs_size); 

DecodeBook = (short* *)NewPtr(cbook_size * sizeof(short*)); 
if (DecodeBook) { 

for (i « 0; i < cbook_size; i+ + ) 

{ 

DecodeBook(i) = p; 
p + = vsize; 

} 

} 

return DecodeBook; 
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} 

SnDeDoneichar *DecodeBook) 
{ 

if ( DecodeBook ! = nil ) 
{ 

DisposPtr(DecodeBook); 

) 

} 

void 

expandtshort * 'DecodeBook, short frame_size, short vsize, 

short min_pitch, struct frame *bs, short 'output, short smpnum) 

short count; 

short *bptr, *sptr1, # sptr2; 
unsigned short pitch, bcode; 

/• 

short qlb_tab[] = { 

1, 2, 3, 4, 5, 6, 7, 8. 

9, 10, 11. 12, 13, 14, 15. 16 

}; 

•/ 

bcode = bs-> bcode; 

pitch = bs-> pitch + min_pitch - 1; 

/• Decode VQ vectors */ 
{ 

unsigned char *cptr; 
short k, vsize_by_2; 

short rshift_count = 7 - bs->gcode; /• We want the output to be 14-bit 
number */ 

sptrl = output + smpnum; 
cptr o bs->vqcode; 

vsize_by_2 = {vsize > > 1) + 1 ; /• + 1 since we do a while H) instead of 
while (M •/ 

if (rshift_count) 
{ 

for (k = 0; k < frame size; k + = vsize) 
{ 

' bptr = DecodeBook! *cptr+ + ]; 
count = vsize_by_2; 
while (-count) 

{ 

*sptr1 + + = (Cbptr++) >> rshift count); 
•sptM + + = (|*bptr + + ) > > rshift~count); 

} 

} 



28 



EP 0 680 652 B1 



else 



10 



15 



20 



25 



30 



35 



40 



} 

} 



for (k = 0; k < frame_size; k + = vsiz ) 

{ 

bptr = DecodeBook[*cptr+ +); 
count = vsize_by_2; 
while {--count) 

{ 

•sptrl + + = *bptr+ +; 
*sptr1 + + = *bptr+ +; 

) 

} 



/* Inverse Filtering */ 
if (smpnum < pitch) 
{ 

sptrl = output + pitch; 

count = smpnum + frame size + 1 - pitch; /• + 1 since we do a while H) 
instead of while (i-) •/ 

Sptr2 = sptrl - pitch; 
switch (bcode) 
{ 

case 0; 

while (-count) 

•sptM + + + = (Csptr2+ +) > > 4); 
break; 
case 1: 

while (--count) 

•sptrl + + += ((*sptr2++) >> 3); 
break; 
case 2: 

while (-count) 

•sptrl + 4- + = ((3 • (*sptr2+ +)) > > 4); 
break; 
case 3: 

while (-count) 

•sptrl + + + = ((*sptr2+ +) > > 2); 
break; 
case 4: 

while (-count) 

45 *sptr1 + + + = ((5 • Csptr2+ +)) >> 4); 

break; 
case 5: 

while {-count} 

"sptrl + + + = 1(3 • (* S ptr2+ +)) > > 3); 
so break; 

case 6; 

while {-count) 
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*sptr1 + + + = ((7 • (*sptr2+ +)) > > 4); 
break: 
case 7: 

while (-count) 

*sptr1 -r + + = {(*sptr2+ +) > > 1); 
break; 
case 8: 

while {-count} 

{ 

long tmp; 

tmp = *sptr2+ +; 

*sptr1 + + + = (((tmp < < 3) + tmp) > > 4); 

} 

break; 
case 9: 

while (-count) 

*sptrl + + + = ((5 * Csptr2+ + )) > > 3); 

break; 
case 10: 

while (-count) 

{ 

long tmp; 

tmp = *sptr2+ + ; 

*sptr1 + + + = (((tmp < < 3) + 3 * tmp) > > 4); 

} 

break; 
case 1 1 : 

while (-count) 

# sptr1 + + + = ((3 # Csptr2+ +)) > > 2); 

break; 
case 12: 

while (-count) 

{ 

long tmp; 

tmp = *sptr2+ +; 

*sptr1 + + + - (((tmp < < 4) - 3 • tmp) > > 4); 

} 

break; 
case 1 3: 

while (--count) 

# sptr1 + + + = ((7 ♦ (*sptr2+ +)) >> 3); 

break; 
case 14: 

while (-count) 

{ 

long tmp; 

tmp = *sptr2+ +; 

* sptr 1 + + + = (((tmp < < 4) - tmp) > > 4); 

} 

break; 
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case 15: 

while (--count) 

*sptr1 + + + = *sptr2 + +; 
break; 

} 

} else { 

sptrl = output + smpnum; 
sptr2 = sptrl - pitch; 
count = (frame_size / 4) + 1; 
switch (bcode) 

{ 

case 0: 

while (-count) { 

*sptr1 + + + = U # sptr2 + + ) > > 4); 
*sptr1 + + + = ((*sptr2 + + ) > > 4); 
*sptr1 + + + = ((*sptr2+ +) > > 4); 
*sptr1 + + + = ((*sptr2 + + ) > > 4); 

} 

break; 
case 1 : 

while (-count) { 

*sptr1 + + + = U*sptr2 + + ) > > 3); 

*sptr1 + + + = ((*sptr2+ +) > > 3); 

*sptM + + + = <(*sptr2 + +) > > 3); 

*sptr1 + + + = ((*sptr2-f +) > > 3); 

} 

break; 
case 2: 

while (-count) { 

*sptr1 + + + = ((3 * (*sptr2+ +)) > > 4) 
*sptr1 + + + = ((3 * (*sptr2 + + )) > > 4) 
♦sptrl + + + m ((3 * Csptr2 + + )) > > 4) 
*sptr1 + + + = ((3 # Csptr2 + +)) > > 4), 

} 

break; 
case 3: 

while (-count) { 

# sptr1 + + + = (fsptr2+ +) > > 2); 
*sptr1 + + + = ((*sptr2+ + ) > > 2); 
*sptr1 + + + = ((*sptr2 + + ) > > 2); 
•sptrl + + + = ((* S ptr2++) >> 2); 

} 

break; 
case 4: 

while (-count) { 

*sptrl + + + = ((5 • (* S ptr2++)) >> 4); 

*sptr1 + + + = {(5 * (*sptr2+ +)) > > 4); 

fc sptr1 + + + = ((5 • (*sptr2 + + )) > > 4); 

*sptr1 + + + = ((5 • Csptr2 + +)) > > 4); 

} 
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break; 
case 5: 

while (-count) { 

•sptrl + + + = «3 * (*sptr2 + + )) > > 3); 

*sptr1 + + + = ((3 • (*sptr2 + +)) > > 3); 

*sptr1 + + + = ({3 * (*sptr2+ + )) > > 3); 

•sptrl + + + = ((3 * Csptr2 + +)) > > 3); 

} 

break; 
case 6: 

while (-count) { 

•sptrl + + + = ((7 • <*sptr2 + + )) > > 4); 

•sptrl + + + = ((7 * Csptr2 + + )) > > 4); 

•sptrl + + + = ((7 * Csptr2 + + )) > > 4); 

*sptr1 + + + = ((7 • Csptr2 + + )) > > 4); 

} 

break; 
case 7: 

while (-count) { 

*sptr1 + + + = (Csptr2 + + ) > > 1); 

•sptrl + + + = (Csptr2++) >> 1); 

•sptrl + + +« (Csptr2++) >> 1); 

•sptrl + + + = ((*sptr2++) >> 1); 

} 

break; 
case 8: 

while (-count) { 
long tmp; 
tmp = *sptr2+ + ; 

♦sptrl + + + « ((8 * tmp + tmp) > > 4); 
tmp = *sptr2+ + ; 

•sptrl + + + « ((8 * tmp + tmp) > > 4); 
tmp - *sptr2 + +; 

•sptrl + + + = ((8 * tmp + tmp) > > 4); 
tmp = *sptr2+ +; 

•sptrl + + + = ((8 • tmp + tmp) > > 4); 

} 

break; 
case 9: 

while (-count) { 

•sptrl + 4- + = ((5 * (*sptr2 + +)) >> 3); 

•sptrl + + + = ((5 * Csptr2+ + )) > > 3); 

•sptrl 4- + + - ((5 * (*sptr2+ +)) > > 3); 

f sptr1 + + + = ((5 • (*sptr2+ +)) > > 3); 

} 

break; 
case 10: 

while (-count) { 
long tmp; 

tmp = *sptr2 + 4 ; 
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*sptr1 + + + = («tmp < < 3) + 3 * tmp) > > 4) 
tmp = *sptr2 + + ; 

*sptr1 + + + = (((tmp < < 3) + 3 * tmp) > > 4) 
tmp = *sptr2+ +; 

*sptr1 + + + = (((tmp < < 3) + 3 • tmp) > > 4) 
tmp = *sptr2+ + ; 

*sptr1 + + + = (((tmp < < 3) + 3 ♦ tmp) > > 4) 

} 

break; 
case 1 1 : 

while (-count) { 

4 sptr1 + + + = ((3 * (* S ptr2+ +)) > > 2); 
•sptrl + + + » ((3 * (*sptr2+ +)) > > 2); 
•sptrl + + + = ((3 * ( *sptr2 + + )) > > 2); 
*sptr1 + + + = ((3 * Csptr2 + + )) > > 2); 

} 

break; 
case 1 2: 

while (-count) { 
long tmp; 

tmp = *sptr2+ +; 

*sptr1 + + + = ({(tmp < < 4) ■ 3 # tmp) > > 4); 
tmp = *sptr2 + +; 

•sptrl + + + = ({(tmp < < 4) - 3 ' tmp) > > 4); 
tmp = *sptr2+ + ; 

•sptrl + + + = (((tmp < < 4) - 3 * tmp) > > 4); 
tmp = *sptr2 + + ; 

•sptrl + + + = {((tmp < < 4) - 3 # tmp) > > 4): 

} 

break; 
case 13: 

while (-count) { 

* sptrl + + + = ({7 * (*sptr2+ +)) > > 3); 
•sptrl + + + = ((7 • ( # sptr2+ + )) >> 3); 
*sptr1 + + + = ({7 * {•sptr2 + +» >> 3); 
•sptrl + + + - ((7 • (*sptr2 + +)) >> 3); 

} 

break; 
case 14: 

while (-count) { 
long tmp; 

tmp = *sptr2+ + ; 

•sptrl + + + « (({tmp < < 4) - tmp) > > 4); 
tmp = *sptr2 + +; 

•sptrl + + + = (((tmp < < 4) - tmp) > > 4); 
tmp = *sptr2 + + ; 

•sptrl + + + = (((tmp < < 4) - tmp) > > 4); 
tmp = *sptr2 + +; 

•sptrl + + + = {((tmp < < 4) - tmp) > > 4); 
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break; 
case 15; ' 

while (--count) { 
*sptr1 + + + 
•sptrl + + + 
# sptr1 + + + 
*sptr1 + + + 

} 

break; 

} 

) 

} 

short SnDecompresstDecodeBook, ratio, framesize, min_pitch, bstream, output) 

short * •DecodeBook, ratio; 

unsigned char * bstream; 

short *output, frame_size, min_pitch; 

{ 

short count, SampCount; 
register short dstate; 
short vcount; 

short vsize, cbook_size, bs_size; 

get_compr_pars(ratio, frame_size, &vsize, &cbook_size, &bs_size); 

dstate = *bstream+ + ; 
dstate = (dstate - 128) < < 6; 

SampCount = 0; 

while(( •bstream & LASTFRAME FLAG) = = 0) 
{ 

expand(DecodeBook f frame_size, vsize, min_pitch, 
(struct frame *)bstream, output, SampCount); 
bstream + = bs_size; 
SampCount + = frame_size; 

} 

vcount = • bstream - LASTJ=RAME_FLAG; 
•bstream = * (bstream + 2 + vcount); 
expand(DecodeBook, frame_size, vsize, min_pitch, 
(struct frame *)bstream, output, SampCount); 
•bstream = vcount + LAST_FRAME FLAG; 
SampCount + = vcount * vsize; 

count = (SampCount >> 1) + 1; 
while (-count) { 

•output ++ = dstate = ((IPCONS • dstate) > > 3) + 'output; 
•output + + = dstate = ((IPCONS # dstate) > > 3) + * output; 

} 

output - = SampCount; 



= *sptr2+ + 

= *sptr2 + -»- 

= *sptr2+ + 

= *sptr2 + + 
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return SampCount; 

} 

^define FILTER state + PFILTORDER + 1 
^define DC_VAL state + PFILT ORDER + PFILT_ORDER/2 + 2 
void SnSampExpandFilUshort *src, short off, short Ten, 
char *dest f short * state) 

{ 

Short input, temp; 

long acc; 
register short dc = *(DC_VAL); 
register short *sptr1, *sptr2; 

src + - off; 
len + + ; 
sptrl = state; 

sptr2 = state + PFILT_ORDER; 
while Hen) { 

input = *src + + - dc; 

dc + = input > > 5; 

temp = input + *sptr1 + + ; /• (statefO] + state[8]) # filterlO] •/ 
acc = temp * * (FILTER); 

temp = *--sptr2 + *sptr1 + +; /* (stated! + state[7]) * filter[1] 
acc + = temp # * (FILTER + 1); 

temp = *--sptr2 + *sptr1 + +; /• (state[2] + state[6]) • filter[2) 
acc + = temp * '(FILTER + 2); 

temp = *~sptr2 + *sptr1 + +; /* (state[3] + state[5]) * filter[3] 
acc + = temp * '(FILTER + 3); 

acc += *sptr1 * *(FILTER + 4); /* state[4] # fiiter[4] •/ 

if (acc > 0) 
{ 

temp = (acc + (257 < < 20)) > > 21; 
if (temp > 255) 
temp = 255; 

} 

else 
{ 

temp = (acc + (255 << 20)) >> 21; 
if (temp < 0) 
temp = 0; 

} 

•dest + + = temp; 
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sptrl -= 4; 
sptr2 -= 4; 

*sptr1 + + = *sptr2 + + ; 
*sptr1 + + = *sptr2+ +; 
*sptr1 + + = *sptr2 + + ; 
*sptr1 + + = *sptr2+ + ; 
# sptrl + + = *sptr2 + +; 
•sptrl + + = *sptr2+ + ; 
•sptrl + + = *sptr2+ +; 
# sptr1 = input; /* 
sptrl - = 7; 

} 

•{DC VAL) = dc; 



/* statelOl = stated] V 

/* stated] = state[2] */ 

/* stateI21 = state[3] */ 

/* state(3] = state[4] */ 

/• state(4] = state[5] */ 

/* state[5] = stateI6] •/ 

/* state|6] = stateI7] •/ 
state[7] = input */ 
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III. BLENDING MODULE 
[0136] 



/• A module for blending two diphones */ 

typedef struct { 

short Iptr, pitch; 

short weight, weightjnc; 
} bstate; 

void SnBlend(pitchp Ip, pitchp rp, short cur_tot, short tot, 
short type, bstate *bs) 

{ 

#pragma unused (tot) 

short count- 
short *ptr1, *ptr2; 

if (type = = VOICED) 
{ 

if (cur_tot) 
return; 

{ 

short weight; 

long min_amdf; 

short bestjag = 0, lag; 

short window_size; 

short weightjnc; 

/* First replicate the left pitch period */ 

ptrl = lp->bufp; 

ptr2 = ptrl + lp->olen; 

count = lp->olen + 1; 

while (--count) 

*ptr2+ + = *ptr1 + +; 

/* Smooth the discontinuity */ 
{ 

register short en r e2; 

en = lp->bufp[2) + 

3 • dp->bufp[0] - lp->bufp[1]) - lp->bufp[lp->olen - 

e2 = lp->bufp[0] - lp->bufp[lp->olen - 1]; 



if (en * en > e2 * e2) 
en = e2; 
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ptr2 = lp->bufp + lp->olen; 
count- = (lp->olen >> 1) + 1: 
while (-count) 
{ 

*--ptr2 + = en; 

en = {({en < < 4) - en) > > 4); 

) 

} 

min_amdf = LARGE NUM; 

window_size = rp->olen; 
if (lp->olen < rp->olen) 

window_size = lp->olen; 

lag = rp->olen; 
while (-lag) 

{ 

long amdf = 0; 

ptrl = rp->bufp; 

ptr2 as lp->bufp + lag; 

count = ((window_size + 3l >> 2) + 1; 

while (-count) 

{ 

short tmp; 

tmp = Cptrl - *ptr2); 
if (tmp > 0) 

amdf + = tmp; 

else 

amdf - = tmp; 
ptrl + = 4; 
ptr2 + = 4; 

) 

if (amdf < min_amdf) 
{ 

bestjag = lag; 
min_amdf = amdf; 

} 



bs-> pitch = lp->olen; 
/* Update left buffer */ 
if (best lag < (lp->olen >> 1)) 

{ 

/* Add bestjag samples to the length of left pulse*/ 

lp->olen + = bestjag; 

} 

else 

{ 

/* Delete a few samples from the left pulse */ 
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lp->olen = bestjag; 

} 

bs->lptr = bestjag; 

weightjnc = 32767/ window_size; 

weight = 32767 - weighrjnc: 

ptrl = rp->bufp; 

ptr2 = lp->bufp + bs- > Iptr; 

count - window_size+ 1 ; 

while (-count) 

{ 

•ptrl + + + = (((short) Cptr2 + + - * ptrl ) * weight) > > 15); 
weight - = weight inc; 

} 

} 



) 

else 

20 { 

register short delta; 

/* Just blend 15 samples */ 
ptr2 = lp->bufp + lp->olen - 15; 
ptrl = rp->bufp; 

for (i = 1 ; i < 1 6; i + + ) 
{ 

•ptrl = *ptr2 + (i * Cptrl - *ptr2)) >> 4; 
ptrl + + ; 
ptr2+ + ; 

} 

delta = *ptr1 - *ptr2; 
*ptr1 + + = *ptr2++ + (delta >> 4); 

delta = *ptr! - # ptr2; 
•ptr1 + + = *ptr2+ + + ((delta) >> 3); 

delta = *ptr1 - *ptr2; 

•ptrl + + = *ptr2 + + + ((3 * delta) > > 4); 

45 delta = *ptr1 - *ptr2; 

•ptrl + + = *ptr2 + + + (delta > > 2); 

delta = *ptr1 - 4 ptr2; 

•ptrl + + = *ptr2+ + + ((5 * delta) > > 4); 



•/ 



delta = *ptr1 - *ptr2; 

•ptrl + + = *ptr2+ + + ((3 * delta) > > 8); 



ss delta = *ptr1 - *ptr2; 
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*ptr1 + + = # ptr2+ + + ({7 # delta) > > 4); 

delta = *ptr1 - *ptr2; 

*ptr1 + + = *ptr2+ + + (delta >> 1); 

delta = *ptr1 - *ptr2; 

*ptr1 + + = *ptr2+ + + (((delta < < 3) + delta) > > 4); 
delta = *ptr1 - *ptr2; 

*ptr1 + + = *ptr2 + + + ((5 * delta) > > 3); 
delta = *ptr1 - *ptr2; 

*ptr1 + + = *ptr2 + + + (((delta < < 3) + 3 # delta) > > 4); 
delta = *ptr1 - *ptr2; 

•ptrl + + = # ptr2+ + + ((3 * delta) > > 2); 
delta = *ptr1 - *ptr2; 

# ptr1 + + = *ptr2+ + + (((delta < < 4) - 3 # delta) > > 4); 
delta = *ptr1 - *ptr2; 

•ptr! + + = *ptr2 + + + ((7 * delta) > > 3); 
delta = *ptr1 - *ptr2; 

•ptrl = # ptr2 + (((delta << 4) - delta) >> 4); 



lp->olen - = 15; 
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IV. INTONATION ADJUSTMENT MODULE 
[0137] 

5 

/* A module for deleting a pitch period */ 
/• 

Pointer srcl points to Left Pitch period 
Pointer src2 points to Right Pitch period 
io Pointer dst points to Resulting Pitch period 

len = length of the pitch periods 

# / 

skip_pulses(short *srd, short *src2, short *dst, short len) 
{ 

15 short i; 

register short weight, cweight; 

i = len + 1 ; 

weight = cweight = 32767/i; 
20 while 
{ 

•dst++ = * S rc1 + + + (((short) Psrc2++ - *srd) * cweight) >> 15); 
cweight + - weight; 

} 

25 } 

/• A module for Inserting a pitch period •/ 

r 

Locn bufferlcurbeg) points to Left Pitch period 
30 Locn bufferlcurbeg + curlen] points to Right Pitch period 

Pointer dst points to Resulting Pitch period 
curlen = length of the pitch periods 

*/ 

insert_pulse(short * buffer, short # dst. short curlen, short curbeg) 

short weight, cweight, count; 
short *src1. *src2; 
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srd « buffer + curbeg; 

src2 = buffer + curbeg + curlen; 

weight = 32767 / curlen; 

cweight = weight; 

count = curlen + 1 ; 

while (-count) 

{ 

•dst++ = *src1 + + = *src2++ + (((short) Csrd - *src2) • cweiqht) >> 

15); 

cweight + = weight; 

} 

} 

/* This module is used to change pitch information in the concatenated speech */ 
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// This routine depends on the desired length (deslen) being at least half 
// and no more than twice the actual length (len). 

5 

void SnChangePitch(short *buf. short *next, short len, short deslen, short Ivoc, short 
rvocshort dosmooth) 

{ 

^pragma unused(rvoc, dosmooth) 
10 short delta; 

short count: 

short # bptr, # aptr; 

short weight, weightjnc; 

if (Mvoc 1 1 (deslen = m len)) return; 

15 

if (deslen > len) 

{ 

/* Increase Pitch period */ 
delta = deslen - len; 
20 bptr = buf + len; 

aptr = buf + deslen; 
count = delta + 1; 
while (-count) 

*-aptr = *--bptr; 

25 

count = len - delta + 1; 

weight = weightjnc = 32767 / count; 

while (-count) 

{ 

30 register short tmp2; 

tmp2 = (*--aptr - *~bptr); 

*aptr = # bptr + {(tmp2 * weight) > > 15); 

weight + = weight inc; 

} 

35 return; 



40 



45 



50 



r Shorten Pitch Period */ 
short wsize; 

delta = len - deslen; 
wsize = 2 * delta; 

if (wsize > deslen) 
wsize = deslen; 

weightjnc = 32767 / (wsize + 1); 
weight = weightjnc; 
aptr = buf + deslen; 
bptr « buf + len - wsize; 
count = wsize - delta + 1 : 
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while (-count) 

{ 

*bptr+ + + = (((short) (*aptr+ + - *bptr) * weight ) > > 15); 
weight + = weightjnc; 

} 

aptr = buf + deslen; 
bptr = next; 
count = delta + 1; 
weight = 32767 - weight; 
while (--count) 
{ 

•bptr+ + + = (((short) («aptr+ + - *bptr) * weight ) > > 15); 
weight -= weight inc.- 

} 

} 

} 



Claims 

25 1. An apparatus for concatenating a first digital frame of N samples having respective magnitudes representing a 
first quasi-periodic waveform and a second digital frame of M samples having respective magnitudes representing 
a second quasi-periodic waveform, comprising: 

a buffer (15) to store the samples of first and second digital frames; 
30 means, coupled to the buffer store, for determining a blend point for the first and second digital frames in 

response to magnitudes of samples in the first and second digital frames; 

blending means, coupled with the buffer store and the means for determining, for computing a digital sequence 
representing a concatenation of the first and second quasi-periodic waveforms in response to the first frame, 
the second frame and the blend point. 

35 

2. The apparatus of claim 1 , further including: 

transducer means, coupled to the blending means, for transducing the digital sequence to an analog con- 
catenated waveform. 

^0 3. The apparatus of claims 1 or 2, wherein the means for determining includes: 

first means for computing an extended frame in response to the first digital frame; 

second means for finding a subset of the extended frame which matches the second digital frame relatively 
well, and defining the blend point as a sample in the subset. 

45 

4. The apparatus of claim 3, wherein the extended frame comprises a concatenation of the first digital frame with a 
replica of the first digital frame. 

5. The apparatus of claim 3 or 4, wherein the subset of the extended frame which matches the second digital frame 
50 relatively well is a subset with a minimum average magnitude difference over the samples in the subset, and the 

blend point is a first sample in the subset. 

6. The apparatus of any preceding claim, wherein the means for determining includes: 

55 first means for computing an extended frame comprising a discontinuity-smoothed concatenation of the first 

digital frame with a replica of the first digital frame; 

second means for finding a subset of the extended frame with a minimum average magnitude difference be- 
tween the samples in the subset and the second digital frame, and defining the blend point as a first sample 
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in the subset. 

7. The apparatus of any preceding claim, wherein the blending means includes: 

means for supplying a first set of samples derived from the first digital frame and the blend point as a first 
segment of the digital sequence; and 

means for combining the second digital frame with a second set of samples derived from the first digital frame 
and the blend point, with emphasis on the second set in a starting sample and emphasis on the second digital 
frame in an ending sample to produce a second segment of the digital sequence. 

8. The apparatus of claim 6, wherein the blending means includes: 

means for supplying a first set of samples derived from the first digital frame and the blend point as a first 
segment of the digital sequence; and 

means for combining the second digital frame with the subset of the extended frame, with emphasis on the 
subset of the extended frame in a starting sample and emphasis on the second digital frame in an ending 
sample to produce a second segment of the digital sequence. 

9. The apparatus of claim 8, wherein the first and second digital frames represent endings and beginnings respectively 
of adjacent diphones in speech, and further including: 

transducer means, coupled to the blending means, for transducing the digital sequence to a sound in speech 
synthesis. 

10. An apparatus for concatenating a first digital frame of N samples having respective magnitudes representing a 
first sound segment and a second digital frame of M samples having respective magnitudes representing a second 
sound segment, comprising: 

a buffer store to store the samples of first and second digital frames; 

means, coupled to the buffer store, for determining a blend point for the first and second digital frames in 
response to magnitudes of samples in the first and second digital frames; 

blending means, coupled with the buffer store and the means for determining, for computing a digital sequence 
representing a concatenation of the first and second sound segments in response to the first frame, the second 
frame and the blend point; and 

transducer means, coupled to the blending means, for transducing the digital sequence to sound. 

11. The apparatus of claim 10, wherein the means for determining includes: 

first means for computing an extended frame in response to the first digital frame; 

second means for finding a subset of the extended frame which matches the second digital frame relatively 
well, and defining the blend point as a sample in the subset. 

12. The apparatus of claim 11 , wherein the extended frame comprises a concatenation of the first digital frame with a 
replica of the first digital frame. 

13. The apparatus of claim 1 1 or 1 2, wherein the subset of the extended frame which matches the second digital frame 
relatively well is a subset with a minimum average magnitude difference over the samples in the subset, and the 
blend point is a first sample in the subset. 

14. The apparatus of any of claims 10 to 13, wherein the means for determining includes; 

first means for computing an extended frame comprising a discontinuity-smoothed concatenation of the first 
digital frame with a replica of the first digital frame; 

second means for finding a subset of the extended frame with a minimum average magnitude difference be- 
tween the samples in the subset and the second digital frame, and defining the blend point as a first sample 
in the subset. 

15. The apparatus of any of claims 10 to 14, wherein the blending means includes: 
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means for supplying a first set of samples derived from the first digital frame and the blend point as a first 
segment of the digital sequence; and 

means for combining the second digital frame with a second set of samples derived from the first digital frame 
and the blend point, with emphasis on the second set in a starting sample and emphasis on the second digital 
frame in an ending sample to produce a second segment of the digital sequence. 

16. The apparatus of claim 14, wherein the blending means includes: 

means for supplying a first set of samples derived from the first digital frame and the blend point as a first 
segment of the digital sequence; and 

means for combining the second digital frame with the subset of the extended frame, with emphasis on the 
subset of the extended frame in a starting sample and emphasis on the second digital frame in an ending 
sample to produce a second segment of the digital sequence. 

17. The apparatus of claim 16, wherein the first and second digital frames represent endings and beginnings respec- 
tively of adjacent diphones in speech, and the transducer means produces synthesized speech. 

18. An apparatus for synthesizing speech in response to a text, comprising: 

means (21 ) for translating text to a sequence of sound segment codes; 

means (23), responsive to sound segment codes in the sequence, for decoding the sequence of sound seg- 
ment codes to produce strings of digital frames of a plurality of samples representing sounds for respective 
sound segment codes in the sequence, wherein the identified strings of digital frames have beginnings and 
endings; 

means (24) for concatenating a first digital frame at the ending of an identified string of digital frames of a 
particular sound segment code in the sequences with a second digital frame at the beginning an identified 
string of digital frames of an adjacent sound segment code in the sequence to produce a speech data se- 
quence, including 

a buffer store to store the samples of first and second digital frames; 

means, coupled to the buffer store, for determining a blend point for the first and second digital frames in 
response to magnitudes of samples in the first and second digital frames; and 

blending means, coupled with the buffer store and the means for determining, for computing a digital sequence 
representing a concatenation of the first and second sound segments in response to the first frame, the second 
frame and the blend point; and 

an audio transducer (27), coupled to the means for concatenating, to generate synthesized speech in response 
to the speech data sequence. 

19. The apparatus of claim 18, further including: 

means (25,26), responsive to the sound segment codes for adjusting pitch and duration of the identified 
strings of digital frames in the speech data sequence. 

20. The apparatus of claim 18 or 1 9, wherein the means for determining includes: 

first means for computing an extended frame in response to the first digital frame; 

second means for finding a subset of the extended frame which matches the second digital frame relatively 
well, and defining the blend point as a sample in the subset. 

21. The apparatus of claim 20, wherein the extended frame comprises a concatenation of the first frame with a replica 
of the first digital frame. 

22. The apparatus of claim 20 or 21 , wherein the subset of the extended frame which matches the second digital frame 
relatively well comprises a subset with a minimum average magnitude difference over the samples in the subset, 
and the blend point comprises a first sample in the subset. 

23. The apparatus of any of claims 18 to 22, wherein the means for determining includes: 

first means for computing an extended frame comprising a discontinuity-smoothed concatenation of the first 
digital frame with a replica of the first digital frame; 
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second means for finding a subset of the extended frame with a minimum average magnitude difference be- 
tween the samples in the subset and the second digital frame, and defining the blend point as a first sample 
in the subset. 

s 24. The apparatus of any of claims 18 to 23, wherein the blending means includes: 

means for supplying a first set of samples derived from the first digital frame and the blend point as a first 
segment of the digital sequence; and 

means for combining the second digital frame with a second set of samples derived from the first digital frame 
10 and the blend point, with emphasis on the second set in a starting sample and emphasis on the second digital 

frame in an ending sample to produce a second segment of the digital sequence. 

25. The apparatus of claim 23, wherein the blending means includes: 

15 means for supplying a first set of samples derived from the first digital frame and the blend point as a first 

segment of the digital sequence; and 

means for combining the second digital frame with the subset of the extended frame, with emphasis on the 
subset of the extended frame in a starting sample and emphasis on the second digital frame in an ending 
sample to produce a second segment of the digital sequence. 

20 

26. The apparatus of any of claims 18 to 25, wherein the sound segment codes represent speech diphones, and the 
first and second digital frames represent endings and beginnings respectively of adjacent diphones in speech. 



25 Patentanspruche 

1. Vorrichtung zur Verkettung eines ersten digitalen Rahmens von N Proben mit jeweiligen Betragen, welche eine 
erste quasiperiodische Wellenform darstellen, und eines zweiten digitalen Rahmens von M Proben mit jeweiligen 
Betragen, welche eine zweite quasiperiodische Wellenform darstellen, mit: 

30 

einem Puffer (15) zum Speichern der Proben des ersten und zweiten digitalen Rahmens; 
Mitteln, welche mit dem Pufferspeicher gekoppelt sind, zur Bestimmung eines Mischungspunktes fur den er- 
sten und den zweiten digitalen Rahmen, ansprechend auf die Betrage der Proben in dem ersten und dem 
zweiten digitalen Rahmen; 

35 - Vermischungsmitteln, welche mit dem Pufferspeicher und den Mitteln zur Bestimmung gekoppelt sind, zur 

Berechnung einer digitalen Sequenz, welche eine Verkettung der ersten und der zweiten quasiperiodischen 
Wellenform ansprechend auf den ersten Rahmen, den zweiten Rahmen und den Vermischungspunkt darstellt. 

2. Vorrichtung nach Anspruch 1 , ferner mit: 

40 

Wandlermitteln, welche mit den Vermischungsmitteln gekoppelt sind, zum Wandeln der digitalen Sequenz in 
eine analoge verkettete Wellenform. 

3. Vorrichtung nach einem der Anspruche 1 Oder 2, bei welcher die Mittel zur Bestimmung aufweisen: 

45 

erste Mittel zur Berechnung eines erweiterten Rahmens ansprechend auf den ersten digitalen Rahmen; 
zweite Mittel zum Auffinden einer Teilmenge des erweiterten Rahmens, welche bezuglich des zweiten digitalen 
Rahmens relativ gut angepaGt ist, und zur Definierung des Vermischungspunktes als einer Probe in der Teil- 
menge. 

so 

4. Vorrichtung nach Anspruch 3, bei welcher der erweiterte Rahmen eine Verkettung des ersten digitalen Rahmens 
mit einer Kopie des ersten digitalen Rahmens aufweist. 

5. Vorrichtung nach einem der Anspruche 3 Oder 4, bei welcher die Teilmenge des erweiterten Rahmens, welche 
55 bezuglich des zweiten digitalen Rahmens relativ gut angepaf3t ist, ein Teilmenge mit einer minimalen mittieren 

bzw. durchschnittlichen Betragsdifferenz uber die Proben in der Teilmenge ist, und der Vermischungspunkt eine 
erste Probe in der Teilmenge ist. 
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6. Vorrichtung nach einem der vorstehenden Anspruche, bei welcher die Mittel zur Bestimmung aufweisen: 

erste Mittel zur Berechnung eines erweiterten Rahmens mit einer diskontinuitatsgeglatteten Verkettung des 
ersten digitalen Rahmens mit einer Kopie des ersten digitalen Rahmens; 
s - zweite Mittel zum Auffinden einer Teilmenge des erweiterten Rahmens mit einer minimalen durchschnitt lichen 

Betragsdifferenz zwischen den Proben in der Teilmenge und dem zweiten digitalen Rahmen, und zur Definie- 
rung eines Vermischungspunktes als einer ersten Probe in der Teilmenge. 

7. Vorrichtung nach einem der vorstehenden Anspruche, bei welcher die Vermischungsmittel aufweisen: 

10 

Mittel zur Zur-Verfugung-Stellung einer ersten Menge von Proben abgeleitet von dem ersten digitalen Rahmen 
und dem Vermischungspunkt als ein erstes Segment der digitalen Sequenz; und 

Mittel zur Kombination des zweiten digitalen Rahmens mit einer zweiten Menge von Proben, welche von dem 
ersten digitalen Rahmen und dem Vermischungspunkt abgeleitet sind, unter Betonung der zweiten Menge in 
15 einer Startprobe und Betonung des zweiten digitalen Rahmens in einer Endprobe zur Herstellung eines zwei- 

ten Segmentes der digitalen Sequenz. 

8. Vorrichtung nach Anspruch 6, bei welcher die Vermischungsmittel aufweisen: 

20 - Mittel zur Zur-Verfugung-Stellung einer ersten Menge von Proben, welche von dem ersten digitalen Rahmen 

und dem Vermischungspunkt abgeleitet sind als ein erstes Segment der digitalen Sequenz; und 
Mittel zur Kombination des zweiten digitalen Rahmens mit der Teilmenge des erweiterten Rahmens, unter 
Betonung der Teilmenge des erweiterten Rahmens in einer Anfangsprobe und Betonung des zweiten digitalen 
Rahmens in einer Endprobe zur Herstellung eines zweiten Segmentes der digitalen Sequenz. 

25 

9. Vorrichtung nach Anspruch 8, bei welcher der erste und der zweite digitale Rahmen Enden bzw. Anfange von 
benachbarten Diphonen bei der Sprache darstellen, und ferner aufweisen: 

- Wandlermittel, welche mit den Vermischungsmitteln gekoppelt sind, zum Wandeln der digitalen Sequenz in 
30 einen Laut bei der Sprachsynthese. 

10. Vorrichtung zur Verkettung eines ersten digitalen Rahmens von N Proben mit jeweiligen Betragen, welche ein 
erstes Lautsegment darstellen, und eines zweiten digitalen Rahmens von M Proben mit jeweiligen Betragen, wel- 
che ein zweites Lautsegment darstellen, mit: 

35 

einem Pufferspeicher zum Speichern der Proben des ersten und des zweiten digitalen Rahmens; 
Mitteln, welche mit dem Pufferspeicher gekoppelt sind, zur Bestimmung eines Vermischungspunktes fur den 
ersten und den zweiten digitalen Rahmen ansprechend auf die Betrage der Proben in dem ersten und dem 
zweiten digitalen Rahmen; 

40 - Vermischungsmitteln, welche mit dem Pufferspeicher und den Mitteln zur Bestimmung gekoppelt sind, zur 

Berechnung einer digitalen Sequenz, welche eine Verkettung der ersten und der zweiten Lautsegmente an- 
sprechend auf den ersten Rahmen, den zweiten Rahmen und den Vermischungspunkt darstellt; und 
Wandlermitteln, welche mit den Vermischungsmitteln gekoppelt sind, zum Wandeln der digitalen Sequenz in 
Laute. 

45 

11. Vorrichtung nach Anspruch 10, bei welcher die Mittel zur Bestimmung aufweisen: 

erste Mittel zur Berechnung eines erweiterten Rahmens ansprechend auf den ersten digitalen Rahmen; 
zweite Mittel zum Auffinden einer Teilmenge des erweiterten Rahmens, welche bezuglich des zweiten digitalen 
50 Rahmens relativ gut angepaBt ist, und zur Definierung des Vermischungspunktes als einer Probe in der Teil- 

menge. 

12. Vorrichtung nach Anspruch 11 , bei welcher der erweiterte Rahmen eine Verkettung des ersten digitalen Rahmens 
mit einer Kopie des ersten digitalen Rahmens aufweist. 

55 

13. Vorrichtung nach einem der Anspruche 11 Oder 12, bei welcher die Teilmenge des erweiterten Rahmens, welche 
bezuglich des zweiten digitalen Rahmens relativ gut angepaBt ist, eine Teilmenge mit einer minimalen durchschnitt- 
lichen Betragsdifferenz uber die Proben in der Teilmenge ist, und der Vermischungspunkt eine erste Probe in der 
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Teilmenge ist. 

14. Vorrichtung nach einem der Anspruche 10 bis 13, wobei die Mittel zur Bestimmung aufweisen: 

s - erste Mittel zur Berechnung eines erweiterten Rahmens mit einer diskontinuitatsgeglatteten Verkettung des 

ersten digitalen Rahmens mit einer Kopie des ersten digitalen Rahmens; 

zweite Mittel zum Auffinden einer Teilmenge des erweiterten Rahmens mit einer minimalen durchschnittlichen 
Betragsdifferenz zwischen den Proben in der Teilmenge und dem zweiten digitalen Rahmen und zur Definie- 
rung des Vermischungspunktes als einer ersten Probe in der Teilmenge. 

10 

15. Vorrichtung nach einem der Anspruche 10 bis 14, wobei die Vermischungsmittel aufweisen: 

Mittel zur Zur-Verfugung-Stellung einer ersten Menge von Proben, welche von dem ersten digitalen Rahmen 
und dem Vermischungspunkt abgeleitet sind, als ein erstes Segment der digitalen Sequenz; und 
15 - Mittel zur Kombination des zweiten digitalen Rahmens mit einer zweiten Menge von Proben, die von dem 

ersten digitalen Rahmen und dem Vermischungspunkt abgeleitet sind, mit Betonung der zweiten Menge in 
einer Startprobe und Betonung des zweiten digitalen Rahmens in einer Endprobe zur Herstellung eines zwei- 
ten Segments der digitalen Sequenz. 

20 16. Vorrichtung nach Anspruch 14, bei welcher die Vermischungsmittel aufweisen: 

Mittel zur Zur-Verfugung-Stellung einer ersten Menge von Proben, die von dem ersten digitalen Rahmen und 
dem Vermischungspunkt abgeleitet sind, als ein erstes Segment der digitalen Sequenz; und 
Mittel zur Kombination des zweiten digitalen Rahmens mit der Teilmenge des erweiterten Rahmens, mit Be- 
25 tonung der Teilmenge des erweiterten Rahmens in einer Startprobe und Betonung des zweiten digitalen Rah- 

mens in einer Endprobe zur Herstellung eines zweiten Segmentes der digitalen Sequenz. 

17. Vorrichtung nach Anspruch 16, bei welcher der erste und der zweite digitals Rahmen Enden bzw Anfange be- 
nachbarter Diphone in der Sprache darstellen, und die Wandlermittel synthetisierte Sprache erzeugen. 

30 

18. Vorrichtung zur Synthetisierung von Sprache ansprechend auf einen Text, mit 

Mitteln (21 ) zur Ubersetzung von Text in eine Sequenz von Lautsegmentcodierungen; 
Mitteln (23), welche ansprechend sind auf die Lautsegmentcodierungen in der Sequenz, zur Decodierung der 
35 Sequenz der Lautsegmentcodierungen zur Herstellung von Strings von digitalen Rahmen einer Anzahl von 

Proben, welche Laute fur jeweilige Lautsegmentcodierungen in der Sequenz darstellen, wobei die identifizier- 
ten Strings der digitalen Rahmen Anfange und Endungen bwz. Enden aufweisen; 

Mitteln (24) zur Verkettung eines ersten digitalen Rahmens an der Endung eines identifizierten Strings von 
digitalen Rahmen einer bestimmten Lautsegmentcodierung in den Sequenzen mit einem zweiten digitalen 
40 Rahmen am Anfang eines identifizierten Strings von digitalen Rahmen einer benachbarten Lautsequenzco- 

dierung in der Sequenz zur Erzeugung einer Sprachdatensequenz, mit 

einem Pufferspeicher zum Speichern der Proben von ersten und zweiten digitalen Rahmen; 
Mitteln, welche mit dem Pufferspeicher gekoppelt sind, zur Bestimmung eines Vermischungspunktes fur 
45 den ersten und den zweiten digitalen Rahmen, ansprechend auf die Betrage der Proben in dem ersten 

und dem zweiten digitalen Rahmen; 

Vermischungsmitteln, welche mit dem Pufferspeicher und den Mitteln zur Bestimmung gekoppelt sind, 
zur Berechnung einer digitalen Sequenz, welche eine Verkettung der ersten und zweiten Lautsegmente 
ansprechend auf den ersten Rahmen, den zweiten Rahmen und den Vermischungspunkt darstellt; und 
50 einem Audiowandler (27), der mit den Mitteln zur Verkettung gekoppelt ist, zur Generierung synthetisierter 

Sprache ansprechend auf die Sprachdatensequenz. 

19. Vorrichtung nach Anspruch 18, ferner mit: 

55 - Mitteln, welche ansprechend auf die Lautsegmentcodierungen sind, zur Einstellung der Tonhohe und der Dau- 

er der identifizierten Strings der digitalen Rahmen in der Sprachdatensequenz. 

20. Vorrichtung nach einem der Anspruche 18 Oder 19, bei welcher die Mittel zur Bestimmung aufweisen: 
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erste Mittel zur Berechnung eines erweiterten Rahmens ansprechend auf den ersten digltalen Rahmen; 
zweite Mittel zum Auffinden einer Teilmenge des erweiterten Rahmens, welcher bezuglich des zweiten digi- 
talen Rahmens relativ gut angepaGt ist und zur Definierung des Vermischungspunktes als einer Probe in der 
Teilmenge. 

5 

21 . Vorrichtung nach Anspruch 20, bei welcher der erweiterte Rahmen eine Verkettung des ersten Rahmens mit einer 
Kopie des ersten digitalen Rahmens aufweist. 

22. Vorrichtung nach einem der Anspruche 20 Oder 21 , bei welcher die Teilmenge des erweiterten Rahmens, welche 
w bezuglich des ersten digitalen Rahmens relativ gut angepaBt ist, eine Teilmenge mit einer minimalen durchschnitt- 

lichen Betragsdifferenz uber die Proben in der Teilmenge aufweist, und wobei der Vermischungspunkt eine erste 
Probe in der Teilmenge aufweist. 

23. Vorrichtung nach einem der Anspruche 18 bis 22, bei welcher die Mittel zur Bestimmung aufweisen: 

15 

erste Mittel zur Berechnung eines erweiterten Rahmens mit einer diskontinuitatsgeglatteten Verkettung des 
ersten digitalen Rahmens mit einer Kopie des ersten digitalen Rahmens; 

- zweite Mittel zum Auffinden einer Teilmenge des erweiterten Rahmens mit einer minimalen durchschnittlichen 
Betragsdifferenz zwischen den Proben in der Teilmenge und dem zweiten digitalen Rahmen, und zur Definie- 

2 0 rung des Vermischungspunktes als einer ersten Probe in der Teilmenge. 

24. Vorrichtung nach einem der Anspruche 18 bis 23, bei welcher die Vermischungsmittel aufweisen: 

- Mittel zur Zur-Verf ugung-Stellung einer ersten Menge von Proben, welche von dem ersten digitalen Rahmen 
25 und dem Vermischungspunkt abgeleitet sind, als ein erstes Segment der digitalen Sequenz; und 

Mittel zur Kombination des zweiten digitalen Rahmens mit einem zweiten Satz von Proben, welche von dem 
ersten digitalen Rahmen und dem Vermischungspunkt abgeleitet sind, mit Betonung der zweiten Menge in 
einer Anfangsprobe und Betonung des zweiten digitalen Rahmens in einer Endprobe zur Herstellung eines 
zweiten Segmentes der digitalen Sequenz. 

30 

25. Vorrichtung nach Anspruch 23, bei welcher die Vermischungsmittel aufweisen: 

- Mittel zur Zur-Verfugung-Stellung eines ersten Satzes von Proben, welche abgeleitet sind von dem ersten 
digitalen Rahmen und dem Vermischungspunkt, als ein erstes Segment der digitalen Sequenz; und 

35 - Mittel zur Kombination des zweiten digitalen Rahmens mit der Teilmenge des erweiterten Rahmens, mit Be- 

tonung der Teilmenge des erweiterten Rahmens in einer Anfangsprobe und Betonung des zweiten digitalen 
Rahmens in einer Endprobe zur Herstellung eines zweiten Segmentes der digitalen Sequenz. 

26. Vorrichtung nach einem der Anspruche 18 bis 25, bei welcher die Lautsegmentcodierungen Sprach-Diphone dar- 
stellen, und der erste und der zweite digitale Rahmen Endungen bzw Anfange benachbarter Diphone in der Spra- 
che darstellen. 



Revendlcatlons 

45 

1. Appareil pour r£unir par concatenation une premiere trame numerique de N echantillons ayant des amplitudes 
respectives repr6sentant une premiere forme d'onde quasi pSriodique et une deuxieme trame numSrique de M 
echantillons ayant des amplitudes respectives representant une deuxieme forme d'onde quasi p6riodique, 
comprenant : 

so 

une mdmoire tampon (15) pour stocker les Echantillons des premiere et deuxieme trames num£riques ; 
des moyens, couples a la memoire tampon, pour determiner un point de juxtaposition pour les premiere et 
deuxieme trames num6riques en reponse a des amplitudes d'echantillons dans les premiere et deuxieme 
trames numeViques ; 

55 des moyens de melange, couples a la memoire tampon et aux moyens de determination, pour calculer une 

sequence numSrique representant une concatenation des premiere et deuxiemes formes d'onde quasi perio- 
diques en reponse a la premiere trame, a la deuxieme trame et au point de juxtaposition. 
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2. Appareil selon la revendication 1, comprenant en outre des moyens de transducteur, couples aux moyens de 
melange, pour convertir la sequence numerique en une forme d'onde analogique constitute par concatenation. 

3. Appareil selon la revendication 1 ou 2, dans lequel les moyens de determination comprennent : 

des premiers moyens pour calculer une trame etendue en teponse a la premiere trame numerique ; 
des deuxiemes moyens pour trouver un sous-ensemble de la trame etendue qui coincide relativement bien 
avec la deuxieme trame nurrterique, et definir le point de juxtaposition comme etant un echantillon dans le 
sous-ensemble. 

4. Appareil selon la revendication 3, dans lequel la trame etendue comprend une concatenation de la premiere trame 
numerique avec une r6plique de la premiere trame num6rique. 

5. Appareil selon la revendication 3 ou 4, dans lequel le sous-ensemble de la trame etendue qui coincide relativement 
*5 bien avec la deuxieme trame numerique est un sous-ensemble ayant une difference moyenne minimale d'ampli- 

tude entre les echantillons dans le sous-ensemble, et le point de juxtaposition est un premier echantillon dans le 
sous-ensemble. 

6. Appareil selon Tune quelconque des revendications precedentes, dans lequel les moyens de determination 
20 comprennent : 

des premiers moyens pour calculer une trame etendue comprenant une concatenation a lissage de disconti- 
nuity de la premiere trame numerique avec une replique de la premiere trame nunrterique ; 
des deuxiemes moyens pour trouver un sous-ensemble de la trame etendue ayant une difference moyenne 
25 minimale d'amplitude entre les echantillons dans le sous-ensemble et la deuxieme trame nurrferique, et definir 

le point de juxtaposition comme etant un premier echantillon dans le sous-ensemble. 

7. Appareil selon I'une quelconque des revendications precedentes, dans lequel les moyens de melange 
comprennent : 

30 

des moyens pour fournir un premier ensemble d'echantillons extraits de la premiere trame nurrferique et du 
point de juxtaposition sous la forme d'un premier segment de la sequence numerique ; et 
des moyens pour combiner la deuxieme trame numerique avec un deuxieme ensemble d'echantillons extrait 
de la premiere trame num6rique et du point de juxtaposition, avec une mise en valeur du deuxieme ensemble 
35 dans un echantillon de debut et une mise en valeur de la deuxieme trame numerique dans un echantillon de 

fin, afin de produire un deuxieme segment de la sequence nunrferique. 

8. Appareil selon la revendication 6, dans lequel les moyens de melange comprennent : 

40 des moyens pour fournir un premier ensemble d'echantillons extraits de la premiere trame nunrferique et du 

point de juxtaposition sous la forme d'un premier segment de la sequence numerique ; et 
des moyens pour combiner la deuxieme trame numerique avec le sous-ensemble de la trame etendue, avec 
une mise en valeur du sous-ensemble de la trame etendue dans un echantillon de debut et une mise en valeur 
de la deuxieme trame numerique dans un echantillon de fin, afin de produire un deuxieme segment de la 

45 sequence numerique. 

9. Appareil selon la revendication 8, dans lequel les premiere et deuxieme trames numeriques represented respec- 
tivement des commencements et des fins de diphones adjacents dans de la parole, et comprenant en outre : 

des moyens de transducteur, couples aux moyens de melange, pour convertir la sequence numerique en 
50 un son dans une synth6se de parole. 

1 0. Appareil pour assembler par concatenation une premiere trame numerique de N 6chantillons ayant des amplitudes 
respectives representant un premier segment de son et une deuxieme trame numerique de M echantillons ayant 
des amplitudes respectives representant un deuxieme segment de son, comprenant : 



55 



une memoire tampon pour stocker les echantillons des premiere et deuxieme trames numeriques ; 

des moyens, couples a la memoire tampon, pour determiner un point de juxtaposition pour les premiere et 

deuxieme trames numeriques en reponse a des amplitudes d'echantillons dans les premiere et deuxieme 
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trames numeriques ; 

des moyens de melange, couples a la m6moire tampon et aux moyens de determination, pour calculer une 
sequence numerique representant une concatenation des premier et deuxiemes segments de son en reponse 
a la premiere trame, a la deuxieme trame et au point de juxtaposition ; et 
5 des moyens de transducteur, couples aux moyens de melange, pour convertir la sequence numerique en un 

son. 

11. Appareil selon la revendication 10, dans lequel les moyens de determination comprennent : 

10 des premiers moyens pour calculer une trame etendue en reponse a la premiere trame numerique ; 

des deuxiemes moyens pour trouver un sous-ensemble de la trame etendue qui coincide relativement bien 
avec la deuxieme trame numerique, et d6finir le point de juxtaposition comme etant un echantillon dans le 
sous-ensemble. 

15 12. Appareil selon la revendication 11, dans lequel la trame Vendue comprend une concatenation de la premiere 
trame numerique avec une rSplique de la premiere trame numerique. 

13. Appareil selon la revendication 11 ou 12, dans lequel le sous-ensemble de la trame etendue qui coincide relati- 
vement bien avec la deuxieme trame numerique est un sous-ensemble ayant une difference moyenne minimale 

20 ^amplitude entre les echantillons dans le sous-ensemble, et le point de juxtaposition est un premier echantillon 

dans le sous-ensemble. 

14. Appareil selon Tune quelconque des revendications 10 a 13, dans lequel les moyens de determination 
comprennent : 

25 

des premiers moyens pour calculer une trame etendue comprenant une concatenation a lissage de disconti- 
nue de la premiere trame numerique avec une rSplique de la premiere trame numerique ; 
des deuxiemes moyens pour trouver un sous-ensemble de la trame etendue ayant une difference moyenne 
minimale d'amplitude entre les echantillons dans le sous-ensemble et la deuxieme trame numerique, et definir 
30 le point de juxtaposition comme etant un premier echantillon dans le sous-ensemble. 

15. Appareil selon I'une quelconque des revendications 10 a 14, dans lequel les moyens de melange comprennent : 

des moyens pour fournir un premier ensemble d'echantillons extraits de la premiere trame numerique et du 
35 point de juxtaposition sous la forme d'un premier segment de la sequence numerique ; et 

des moyens pour combiner la deuxieme trame num6rique avec un deuxieme ensemble d'echantillons extrait 
de la premiere trame numerique et du point de juxtaposition, avec une mise en valeur du deuxieme ensemble 
dans un echantillon de debut et une mise en valeur de la deuxieme trame numerique dans un echantillon de 
fin, afin de produire un deuxieme segment de la sequence numerique. 

40 

16. Appareil selon la revendication 14, dans lequel les moyens de melange comprennent : 

des moyens pour fournir un premier ensemble d'echantillons extraits de la premiere trame numerique et du 
point de juxtaposition sous la forme d'un premier segment de la sequence numerique ; et 
45 des moyens pour combiner la deuxieme trame numerique avec le sous-ensemble de la trame etendue, avec 

une mise en valeur du sous-ensemble de la trame etendue dans un echantillon de debut et une mise en valeur 
de la deuxieme trame numerique dans un echantillon de fin, afin de produire un deuxieme segment de la 
sequence numerique. 

so 17. Appareil selon la revendication 16, dans lequel les premiere et deuxieme trames num6riques represented res- 
pectivement des fins et des commencements de diphones adjacents dans de la parole, et les moyens de trans- 
ducteur produisent une parole synthetisee. 

18. Appareil pour synthetiser de la parole en reponse a un texte, comprenant : 

55 

des moyens (21) pour traduire un texte en une sequence de codes de segment de son ; 

des moyens (23) r6pondant aux codes de segment de son dans la sequence, pour decoder la sequence de 

codes de segment de son afin de produire des chaines de trames num6riques d'une plurality d'echantillons 
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repr6sentant des sons pour des codes correspondants de segment de son dans la sequence, dans lequel les 
chaines identifiers de trames numeriques ont des commencements et des fins ; 

des moyens (24) pour r6unir par concatenation une premiere trame numerique a la fin d'une chaTne identified 

de trames numeriques d'un code particulier de segment de son dans la sequence, avec une deuxieme trame 

numerique au debut d'une chaine identifi6e de trames numeriques d'un code adjacent de segment de son 

dans la sequence, afin de produire une sequence de donnees de parole, comprenant 

une memoire tampon pour stocker les echantillons de premiere et deuxieme trames numeriques ; 

des moyens, couples a la memoire tampon, pour determiner un point de juxtaposition pour les premiere et 

deuxieme trames numeriques en reponse a des amplitudes d'echantillons dans les premiere et deuxieme 

trames numeriques ; et 

des moyens de melange, couples a la memoire tampon et aux moyens de determination, pour calculer une 
s6quence numerique repr6sentant une concatenation des premier et deuxiemes segments de son en reponse 
a la premiere trame, a la deuxieme trame et au point de juxtaposition ; et 

un transducteur audio (27), couple aux moyens de concatenation, pour produire une parole synth6tis6e en 
reponse a la sequence de donne-es de parole. 



20 



19. Appareil selon la revendication 18, comprenant en outre : 

des moyens (25, 26) repondant aux codes de segment de son pour ajuster la hauteur et la duree des chaines 
identifiees de trames numeriques dans la sequence de donnees de parole. 

20. Appareil selon la revendication 18 ou 19, dans lequel les moyens de determination comprennent: 



des premiers moyens pour calculer une trame etendue en reponse a la premiere trame numerique ; 
des deuxiemes moyens pour trouver un sous-ensemble de la trame etendue qui coincide relativement bien 
25 avec la deuxieme trame numerique, et definir le point de juxtaposition comme 6tant un 6chantillon dans le 

sous-ensemble. 



21. Appareil selon la revendication 20, dans lequel la trame etendue comprend une concatenation de la premiere 
trame numerique avec une replique de la premiere trame num6rique. 

22. Appareil selon la revendication 20 ou 21 , dans lequel le sous-ensemble de la trame etendue qui coincide relati- 
vement bien avec la deuxieme trame numerique comprend un sous-ensemble ayant une difference moyenne 
minimale d'amplitude avec les echantillons dans le sous-ensemble, et le point de juxtaposition comprend un pre- 
mier echantillon dans le sous-ensemble. 

23. Appareil selon I'une quelconque des revendications 18 a 22, dans lequel les moyens de determination 
comprennent : 

des premiers moyens pour calculer une trame etendue comprenant une concatenation a lissage de disconti- 
nue de la premiere trame num6rique avec une replique de la premiere trame numerique ; 
des deuxiemes moyens pour trouver un sous-ensemble de la trame etendue ayant une difference moyenne 
minimale d'amplitude entre les echantillons dans le sous-ensemble et la deuxieme trame numerique, et definir 
le point de juxtaposition comme 6tant un premier echantillon dans le sous-ensemble. 

24. Appareil selon Tune quelconque des revendications 18 a 23, dans lequel les moyens de melange comprennent : 

des moyens pour fournir un premier ensemble d'echantillons extraits de la premiere trame numerique et du 
point de juxtaposition sous la forme d'un premier segment de la sequence numerique ; et 
des moyens pour combiner la deuxieme trame numerique avec un deuxieme ensemble d'echantillons extraits 
de la premiere trame numerique et du point de juxtaposition, avec une mise en valeur du deuxieme ensemble 
dans un echantillon de debut et une mise en valeur de la deuxieme trame numerique dans un echantillon de 
fin, afin de produire un deuxieme segment de la sequence numerique. 

25. Appareil selon la revendication 23, dans lequel les moyens de melange comprennent : 

des moyens pour fournir un premier ensemble d'echantillons extraits de la premiere trame numerique et du 

point de juxtaposition sous la forme d'un premier segment de la sequence numerique ; et 

des moyens pour combiner la deuxieme trame numerique avec le sous-ensemble de la trame etendue, avec 
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une mise en valeur du sous-ensemble de la trame Vendue dans un Schantillon de d6but et une mise en valeur 
de la deuxieme trame num6rique dans un echantillon de fin afin de produire un deuxieme segment de la 
sequence num^rique. 

s 26. Appareil selon I'une quelconque des revendications 1 8 a 25, dans lequel les codes de segment de son represented 
des diphones de parole, et les premiere et deuxieme trames num^riques represented respectivement des fins et 
des debuts de diphones adjacents dans de la parole. 
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L n + R n + a 



404 



FIG. -13 
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INSERT PITCH PERIOD 
BETWEEN L n AND R n 



450 



STORE 


L n AND R n 


IN 


BUFFER 



GENERATE LEFT 
VECTDR VL <L n ) 
(ENDING MOST SIGNIFICANT) 



451 



45S 



GENERATE RIGHT 
VECTDR VR <R n ) 

<BEGINING MOST SIGNIFICANT) 



I 



BLEND VR <L n ) AND VR <R n ) 
TD INSERTED PERIDD x n 



453 



454 




455 



FIG. -15 
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Ln 





FIG. -16 
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,-1 
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INSERT PITCH PERIOD 
R n WHICH FOLLOVS L n 



500 



STORE 


L n AND R n 


IN 


BUFFER 



GENERATE LEFT 
VECTOR VL (L n ) 
(BEGINING MOST SIGNIFICANT) 



GENERATE RIGHT 
VECTOR VR (Rn) 
(ENDING MOST SIGNIFICANT) 



501 



502 



503 



BLEND VL (L n ) AND VR (R n ) 
TO CREATE RESULTING L' n 



REPLACE L n — * R n VITH 
L' n IN PITCH PERIOD STRING 



504 



505 



FIG. -17 
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